Sr. Data Engineer
Crystal IS
The Asahi Kasei Group operates with a commitment of creating for tomorrow. Our business sectors, Material, Homes, and Health Care, contribute to the development of society by anticipating the changing needs of those around the world. We look for candidates that offer a fresh perspective and a variety of skills to help us achieve our commitment.
We are currently seeking applications to fill the following job opening:
Company:
Job Description:
Position Type: Full time / HYBRID - (Office - 1-2 times a week)
Location: 3540 Toringdon Way, Suite 200, Charlotte, NC 28277
Description:
Evaluate and improve T-SQL, MDX, DAX, HiveQL programming concepts such as queries, stored procedures, functions, temporary tables, parameterization, complex joins and groupings.
Develop and optimize ETL/ELT pipelines, to load data from on premise and online systems.
Ensure data solutions stability and performance optimization.
Conduct data warehouse model design, development and support.
Prepare, cleanse, validated datasets for data science purpose.
Assist data troubleshooting, data featuring and data discovery.
Develop tools to automate development and monitoring process.
Develop python algorithms for data processing.
Support Data science environment, assists data science projects.
Manage time effectively to ensure that projects delivered on schedule.
Provide on-going maintenance and support of existing and new data solutions.
Support solution automation and CI/CD.
Remote/Hybrid work schedule - Report to Charlotte, NC office (1-2 times per week)
Travel - 5% including travel to Europe once per year.
Qualifications:
- Bachelor’s Degree in Computer Science / Information technology or related field AND five (5) years as Data Engineer, Big Data Engineer, Data Architect, SQL Developer, Database Developer, or related.
- Applicants must have 5 years’ experience with:
Developing business intelligence solutions including data integration, data schema development, data pipelines, modeling and reporting/analytics
Database design principles, data modeling, partitioning, and data warehouse
Python, and Shell scripting
SQL writing and query tuning, and query performance optimization
data analysis, data modeling, data migration, computer programming, and problem-solving.
- Applicants must have 4 years’ experience with:
Data validation, cleansing, featuring: Pandas, Spark dataframes, and DQ solutions.
- Applicants must have 3 years’ experience with:
CI/CD.
CDC.
- Applicants must have 2 years’ experience with:
big data pipeline development, monitoring and support: ETL, SSIS, Hadoop, HDFS, Spark, Hive, RDD, and UDF.
cloud data ecosystem: Spark API, Spark SQL, PySpark, Scala, Python, and data Streaming.
- Applicants must have demonstrative experience with:
data science tools: Python ML, Scala, and Databricks.
As an equal opportunity employer, Asahi Kasei believes a diverse workforce will provide us with the ability to continuously support the changes in the economy, society, and environment.