Job Title: Azure Data Engineer
Location: Weehawken, NJ ( 5 days WFO)
Job Type : Fulltime
8+ years exp
JOB Description :
Expert level skills writing and optimizing complex SQL
Experience with complex data modelling, ETL design, and using large databases in a business environment
Experience with building data pipelines and applications to stream and process datasets at low latencies
Fluent with Big Data technologies like Spark, Kafka and Hive
Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required
Designing and building of data pipelines using API ingestion and Streaming ingestion methods
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential
Experience in developing NO SQL solutions using Azure Cosmos DB is essential
Thorough understanding of Azure and AWS Cloud Infrastructure offerings
Working knowledge of Python is desirable
Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services
Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB
Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance
Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards
Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging
Best Regards,
Dipendra Gupta
Technical Recruiter
Dipendra.gupta@programmers.ai
ENR Top Ranked Commercial & Multi-Family GC with a growing Office in Fort Myers Looking to Bring on a Lead Superintendent! Large Bonuses, Best in Class Benefits, Work Flexibility! This Jobot Job is hosted by: Ben Kimbrel Are you a fit? Easy Apply now by clicking...
...Job Description Job Description Zone IT Solutions is seeking a talented UI/UX Designer who will contribute to creating exceptional user experiences for our clients. This role involves collaborating closely with cross-functional teams to design impressive, user-friendly...
...power our future. Job Description Nielsen's Corporate Audit Staff (CAS) is a fast-paced, dynamic, and highly-selective team... ...We are seeking a detail-oriented and analytical Finance Audit Associate to execute audits within our dynamic Internal Audit function. This...
...Ryder is Now Hiring Regional CDL-A Truck Drivers \nImmediate Opening for a Regional... ...Miles Pay:$0.62 per mile with 2,000-3,000 miles per week \n... ...: \n\n \n\t ~ HAZMAT and Tanker endorsement required... ...years is required \n\t ~ Valid Class A CDL \n\t ~9 months of experience...
...team as a day shift, full-time, Surgery Surgical Technician in Albuquerque, NM .... ...Learn About a Day In the Life of a Surgical Tech: Responsibilities: Assists surgeons with... ...terminology. Six (6) months of experience in an operating room or ambulatory surgery...