Over 5 years of professional IT experience in Design, Data Modeling, Development and Implementation of various client server and decision support system environments with focus on Big Data,and DatabaseApplications.
good level of experience in Core Java,J2EE technologies as JDBC,Servlets and JSP.
April 2022 - August 2022
Working as Data Engineer;Responsible for data development and maintenance of Regulatory reports
Dec 2020 - March 2022
Migrate data from multiple source systems such as HBase, Mysql, and Redis to Hadoop distributed file system for data analysis.Developed Spark programs in Scala to perform data transformation,creating DataFrames and Running Spark SQL and Spark Streaming application in Scala
JUL 2019 - DEC 2020
Building SMS recommendation system based on collected base station signaling, Send marketing text messages to people entering a specific area.Built real time data pipelines by developing Kafka producers and Spark streaming applications for consuming
JUL 2017 - JUL 2020
Developed hightly interactive and customized UIs using JavaScript,HTML,JSP,and CSS to improve functionality of web application. Developed new applications using Spring framework backend and jsp frontend .Develop web applications for client server environments and add functionalities to existing applications
Aug 2022 - Present
I have learned Web Application Development And Cloud Computing.
July 2013 - June 2017
Major in Communication Engineering.I have learned C++,C language And System Design.
I have handled multiple project assignments with minimal direction, escalate issues . I am professional in various ETL techniques and frameworks, Data stage, Informatica. I have experience in working with AWS Cloud Infrastructure and Networking IAM, VPC, Security Groups, CodePipelines, CodeBuilder, CodeDeploy
We have successfully manage the data in S3 to Glue.we have defined the schema by ourself and we can use athena to operate the data.the schema is stored in Glue,and the Data is stored in s3. It is pretty like hive framework.In have the data is stored in HDFS and the meta data is stored in Mysql table which is managed by hive.
I am professional in ETL and Data processing . I am also Good at implement ETL processes, such as data transformation using tools including HQL, Spark, Scala I do my best to ensure data quality, maintain profiles of data products, monitor system performance
Create and maintain optimal data pipeline architecture.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
Build processes supporting data transformation, data structures, metadata, dependency and workload management.Create data tools for analytics and data scientist team members that assist them in building and optimizing data science products.
Design and build our data ingestion & transformation infrastructure to scale to thousands of sources, including public & private healthcare data and customer data.Develop and manage data infrastructure to enable, and give leverage to, analytics and machine learning engineers
1000N STH
FairField, IA
52557 US
melissa.0.long@gmail.com
meijuan.long@miu.edu
Phone: (+1) 641 233 9214
Mobile: (+86) 18664587659
