Lo sentimos, la oferta no está disponible,
pero puedes realizar una nueva búsqueda o explorar ofertas similares:

Senior Backend Engineer (Elixir)

The positionYou'll be joining 250 engineers across Frontend, Backend, SRE and QA. We're organised into cross-functional development teams assigned to specifi...


Desde Remote - Pando

Publicado 8 days ago

Senior It Operations Engineer

What this job can offer youThe IT team at Remote is the backbone ensuring seamless operation and innovation in our remote-first ecosystem. By integrating the...


Desde Remote - Pando

Publicado 7 days ago

Developer C#/.NET Developer

About us Begin a career with one of the world’s largest virtual companies where you have flexibility and space to grow, just as we have been able to thanks ...


Desde Scopic Software - Bolivia

Publicado 4 hours ago

Mecânico(A) Industrial Pleno

Job descriptionEstamos em busca de um(a)Mecânico(a) Industrial Plenopara compor o time deManutenção Mecânicado Bioparque Tarumã localizado na cidade de Tarum...


Santa Cruz

Publicado 10 days ago

Senior Data Engineer

Senior Data Engineer
Empresa:

Mastercontrol


Detalles de la oferta

About MasterControl:
MasterControl Inc. is a leading provider of cloud-based quality and compliance software for life sciences and other regulated industries. Our mission is the same as that of our customers to bring life-changing products to more people sooner. The MasterControl Platform helps organizations digitize, automate and connect quality and compliance processes across the regulated product development life cycle. Over 1,000 companies worldwide rely on MasterControl solutions to achieve new levels of operational excellence across product development, clinical trials, regulatory affairs, quality management, supply chain, manufacturing and postmarket surveillance. For more information, visit www.mastercontrol.com.

Job Summary
At MasterControl we are building our next generation data platform that will leverage AI/ML techniques to help redefine how our customers bring lifesaving and lifechanging products to market. To enable this, we need your help building our Data Pipeline, Data Mart, and Data Lake.
You will be responsible for implementing the data lifecycle consumption from the data source to the end model. By gathering requirements from Product, you will transform data in near real-time which will be consumable by AI model training, business intelligence analytic tools, and self-service platforms. You will need a strong emphasis on data modeling, as well as proficiency in data transformation. You will be responsible for integration into the CI/CD pipeline as well as unit and integration testing of all processes. You will need experience with structured, semi-structured, and unstructured data sources. You will need a bachelor's degree in a STEM related field, or equivalent experience. You should have performed multiple successful deployments of production Big Data systems.
Responsibilities
Pull data from all customer databases into Kafka
Model the data for optimal performance (ETL, star-schema like, ORC, partitioning, etc ...)
Pull data from a real-time streaming architecture (Kafka) and do near-real-time aggregations and projections of the data, storing the results in S3
Help automate the provisioning of AWS Lake Formations, EMR/Spark/S3/Kafka and other services in AWS
Analyze data to find patterns worthy to expose to the end-user
Help tie corporate data to customer data from an OLTP store
Help us discover ways to use Big Data technologies in a Machine Learning pipeline (discover, clean, label, train, test)
Other assigned duties

Skills
Kafka, Spark, Airflow, Hudi, S3
Scala, Python, SQL, Java
Warehouse Architectures (Star Schema/Snowflake/Vaults/Lakes)
Familiarity with AWS and Cloud Formation or Terraform
Data Modelling
ELT/ETL Best Practices
Apache Spark with EMR and/or other Big Data tools
Kafka Streams experience is a plus
Airflow experience is a plus
Big Data Mindset (Spark/Hive/Hadoop/HCatalog/Hudi). Understanding of the Big Data landscape.
Meet multiple, challenging deadlines while communicating expectations clearly.

Physical Demands And Working Conditions
Must be able to work well with people.
Ability to operate a computer and work at a desk for extended periods of time.
Ability to communicate effectively in writing, in person, over the telephone and in e-mail.

Why Work Here?
#WhyWorkAnywhereElse?
MasterControl is a place where Exceptional Teams come together to do their best work. In fact, hiring Exceptional Teams is a core value of ours. MasterControl employees are surrounded by intelligent, motivated, and collaborative individuals. We like to call it #TheBestTeamOnThePlanet.
We work hard to develop and challenge our employees' skillsets, recognize their contributions, encourage professional development, and offer a one-of-a-kind culture. This is why we say #WhyWorkAnywhereElse?
MasterControl could be your next (and last) career move!
Here are some of the benefits MasterControl employees enjoy:
Competitive compensation
100% medical premium coverage (yes, you read that right!)
401(k) plan with company match
Generous PTO packages that increase with tenure
Schedule flexibility
Fitness clubs (you get paid to have fun and be active!)
Company parties and employee recognition programs
Wellness programs (free Fitbit, gym membership and athletic shoe reimbursements, etc.)
Onsite physician and massage therapist
Innovation center and gaming rooms at the office
Dental/vision plans
Employer paid life insurance policy
Much, much more!

Applicants must be currently authorized to work in the United States on a full-time basis.


Fuente: Applicantpro

Requisitos


Conocimientos:
Senior Data Engineer
Empresa:

Mastercontrol


Built at: 2024-04-18T14:18:36.428Z