Technical Safety BC Data Engineer Full Time in Vancouver, BC

Status: Regular, Full Time, Union
Pay Rate: $48.17 – 55.78/hour
Reports to: Leader, Research & Analytics

Principal Accountabilities:

• Responsible for data engineering for the machine learning component of RAP (predictive algorithm used for Resource Allocation Program at Technical Safety BC)
• Responsible for developing and maintaining critical data infrastructures to support machine learning processes and expand data science platform and tools.
• Responsible for selecting and integrating any Big Data tools and frameworks required to provide requested capabilities such as Tensorflow
• Responsible for monitoring performance and advising any necessary infrastructure changes through automation
• Creation of version control and roll back strategy of the machine learning processes
• Apply leadership and promote value of data science to help make sound safety decisions.
• Able to communicate and collaborate effectively with BI team to support various BI development projects
• Work with multiple, complex data sources such as social media APIs and other open source APIs
• Design, build, implement & test machine learning models, and ship deployment-ready versions into production
• Identify and implement new data sources/patterns that add significant lift to machine learning models
• Develop innovative solutions to hard machine learning problems
• Able to conduct independent research

Knowledge, Skills & Experience:

Education and Experience

• Master’s in computer science,

computer engineering, big data and statistics or equivalent work experience

• Typically requires over 6 years data

engineering, data science, or software engineering experience.

• Capability to architect highly scalable distributed systems, using different open source tools
• Demonstrated experience with agile or other rapid application development methods.
• Demonstrated experience with object oriented design, coding and testing patterns as well as experience in engineering (commercial or open source) software platforms and largescale data infrastructures.
• Understands how algorithms work and have experience building high performance algorithms.
• Extensive knowledge in different programming or scripting languages.
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases.
• Experience using Big Data batch and streaming tools.
• Experience with Spark
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O

Knowledge and Skills

• Business savvy to be able to translate technical work to business values
• Highly motivated to tackle multiple projects in parallel
• Aptitude to independently learn new technologies
• Excellent written and oral communication skills and ability to share findings with a large, non-technical audience
• Solid understanding of experimental design, combined with creativity and curiosity to explore innovative solutions
• Solid understanding of IT systems, databases, and data management including data quality
• Solid communication and interpersonal skills to engage in collaborative dialogue with internal and external customers/stakeholders
• Solid planning skills to develop plans for designated projects and assignments
• Solid analytical, problem-solving and decision-making skills to identify and take action to assess needs, address challenges, and manage change
• Ability to work with a wide range of stakeholders
• Basic leadership skills to provide day-to-day technical guidance