Search jobs > Toronto, ON > Big data developer

DataStage Developer – Big Data

Nexus Systems Group Inc.
Old Toronto, ON, Canada
$112.4K-$156.1K a year (estimated)
Full-time

Typical Day in Role :

  • You will write well designed, testable, efficient code by using best software development practices.
  • You will gather and refine specifications and requirements based on technical needs.
  • Create and maintain software documentation.
  • Develop strategies for Extraction, Transformation and Loading (ETL) mechanisms.
  • Design Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
  • Analyze the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
  • Study the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
  • Direct day-to-day activities in a manner consistent with our risk culture and the relevant risk appetite statement and limits and communicate it throughout the team.
  • Create an environment in which your team pursues effective and efficient operations of their respective areas while ensuring the adequacy, adherence to and effectiveness of day-to-day business controls to meet obligations with respect to risk and compliance.

Candidate Requirements / Must-Have Skills :

  • Overall 10+ years of experience in development with at least 5+ years of deep experience creating and supporting ETL integrations (batch and real-time).
  • You have 3+ years of hands-on experience with Parallel jobs like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XM.
  • You have 3+ years of hands-on experience with DataStage Manager, Designer, Administrator, and Director.
  • You have 3+ years of hands-on experience with Big Data concepts and platforms, such as Hadoop / Hive / Beeline / EDL.
  • You are an expert in UNIX shell scripts using K-shell for the automation of processes and scheduling DataStage jobs.

Nice-To-Have Skills :

  • You have Data Warehousing skills and experience in dimensional modeling.
  • You have experience in Data Modeling as well as reverse engineering using tools like Erwin and MS Visio as an asset.
  • You have experience in integration of various data sources (DB2-UDB, PL / SQL, Hadoop data) into data staging area.
  • You have experience in performance tuning and enhancement as an asset.

Soft Skills :

  • Excellent written, presentation, and verbal communication skills to be able to work well with technical peers and business stakeholders at different levels within the organization.
  • Strong decision making, forward thinking and creative problem-solving skills to anticipate and respond quickly to technological / market influences.
  • Ability to work as part of a team, as well as work independently with minimal direction.

Education :

Bachelors in computer science or computer engineering.

J-18808-Ljbffr

1 day ago
Related jobs
Promoted
Procom
Toronto, Ontario

On behalf of our client in the Banking Sector, Procom is looking for a DataStage Developer - Big Data DataStage Developer - Big Data. DataStage Developer - Big Data. ...

Promoted
Net2Source Inc.
Toronto, Ontario

Big Data Developer with Java Development. Big Data applications using Java/Scala and Spark on Cloudera/HDP. Experience in building end to end data pipelines on AWS/Azure and/or Databricks. Note: Hadoop, Spark and Java Developer with Minimum 5 years of hands-on experience. ...

Promoted
Open Systems Technologies
Mississauga, Ontario

Design best architecture and select the most appropriate modeling techniques and data visualization for big data analysis. Job Title: Senior Python/Big Developer. Data Analysis and Data Wrangling skills when dealing with Huge Volume(1B+ Transaction). Performance analysis, troubleshooting and resolut...

Promoted
First Derivative
Toronto, Ontario

Senior Java/Big Data Developer:. Implement data products curated by our Chief Data Office, as well as custom data models for fit for use. Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability. Experience with big data tools: ...

Promoted
ProViso Staffing
Toronto, Ontario

The DataStage Developer will work closely with the product owner, business analysts, and Data Architects to understand the business functions and requirements and implement a solution to extract and transform the data from various source systems. Analyze the data generated by the business process, d...

CGI
Toronto, Ontario

Big Data applications using Java/Scala and Spark on Cloudera/HDP. Experience in building data pipelines on AWS/Azure and/or Databricks. The primary focus of this role is to provide re-engineering expertise, covering design, implementation and support of the RM and FRTB applications, namely Aggregati...

Randstad Canada
Toronto, Ontario

Experience with Big data stack is an advantage. Are you a Software Developer looking for a new opportunity?. We are pleased to offer you a new contract opportunity for you to consider: Software Developer. Relational and Object database knowledge 2-3 years. ...

Royal Bank of Canada
Toronto, Ontario

Individual will work as a Big Data Application Developer with the AML IT team, delivering services to implement technical and business needs, and working closely with various partners across IT and business. Our technology stack is composed of Big-Data Hadoop Cluster Spark framework, Pega v8, Java/S...

Randstad Canada
Toronto, Ontario

Experience with Big data stack is an advantage. Are you a Software Developer looking for a new opportunity?. We are pleased to offer you a new contract opportunity for you to consider: Software Developer. Relational and Object database knowledge 2-3 years. ...

0000050007 Royal Bank of Canada
Toronto, Ontario

Amazon Redshift, Apache Hadoop, Apache Spark, AWS Cloud Computing, Big Data Management, Cloud Computing, Data Warehouse Development, Docker (Software), Java, Kubernetes, Microservices Architecture, Microsoft Azure, Microsoft Azure Databricks, Python (Programming Language), Red Hat OpenShift, Require...