Skip to content

Career Opportunity

Innovation Team Data Engineer - Mayor's Office of Innovation (1043)

Recruitment: RTF0144712-01148102

Published: February 08, 2024


Connie Poon -

Apply using SmartRecruiters, the City and County of San Francisco's application portal Learn More

Department: City Administrator
Job class: 1043-IS Engineer-Senior
Salary range: $146,250.00 - $184,002.00
Role type: Temporary Exempt What does this mean?
Hours: Full-time


The Mayor’s Office of Innovation is a new team working on Mayoral-directed strategic priorities, emphasizing data analysis, human-centered design thinking, cross-departmental coordination, and public-private partnerships to ensure outcomes-based policy making.  
The Innovation Team is focused on improving service delivery and city performance across the City through replicable, strategic projects in key policy areas like small business recovery, housing, and homelessness and mental health services.  

Priority initiatives could include a customer journey and data insight project to demonstrate how City dollars are funding better outcomes through our non-profit partners. This role focuses on issues such as:

  • The City grants millions of dollars to non-profit organizations to address homelessness but has no way of demonstrating the outcomes of grants across all departments.  

  • The City funds services delivered by many non-profit organizations, but has no data set of all City-funded services. 

  • There is no reliable and up-to-date list of City-funded services that departments and non-profit organizations can use, making it hard for residents to be referred to services when they need help.  

  • Data access across departments is siloed, limiting the City’s capacity for system-level analysis and improvement.   

We are looking for a curious and resourceful Data Engineer to show the power of data in bringing transparency and accountability to services, while keeping equity and ethical use of data at the forefront.  

We offer flexibility with a hybrid remote and in-person work environment in our office in San Francisco, California (minimum 2 days per week at City Hall, otherwise remote). Must be a California resident.

Role description

As the Innovation Team Data Engineer, you will be a part of the Mayor’s Innovation Team, and report to the Mayor’s Office. However, your position is based within Digital Services under DataSF, and will collaborate closely with the Chief Data Officer and the Chief Digital Services Officer.  

You will work directly with the Mayor’s policy staff and Department leadership, as well as community providers to identify existing data, gaps in reporting, and develop outcomes-based reporting structures. 

This position is funded, in part, through the Bloomberg Philanthropies Government Innovation Team, and will work in close partnership with the Bloomberg Center for Public Innovation at Johns Hopkins University.  

The Innovation Team will also include a Data Program Manager, a Service Designer, and a Project Manager. As a small and agile team, you will work together to deliver prototypes and solutions that will help address the city’s most pressing challenges. 

As the Data Engineer, you will be the technical lead on the program, working with stakeholders in departments to understand data sources and pipelines and building these out in a pragmatic way. You will advise the Mayor’s Office on the most feasible deliverables that are both technically possible, and high impact. You will be supported throughout by the rest of the Innovation team, the Chief Data Officer, and the Chief Digital Services Officer. You will: 

  • Work with departmental staff to develop extract, transform, load (ETL) requirements for individual datasets 

  • Consult with various departments on the best way to automate and publish datasets within their data ecosystems 

  • Apply an ethical lens to the appropriate use of data 

  • Create new analytics pipelines using ETL/ELT approaches according to standards and patterns you help develop and refine 

  • Serve as the technical lead for database exports, manipulation, and procedures used to create and update data incorporated into the data platform 

  • Implement analytics pipelines and/or data models to support analytics work 

  • Migrate existing ETLs to newer infrastructure to improve data quality and reliability as needed 

  • Standardize and improve existing pipelines to adhere to best practices 

  • As needed help iterate and refine best practices 

You will also identify ways in which data standardization, and data access, can contribute to the City’s commitment to equitable and ethical service delivery and analytics. In collaboration with departments, you will identify data gaps that hinder equity analysis.  

Removing barriers and making it easier for all people to access services or knowledge is a core part of any role with DataSF and the Innovation Team. Beyond any technical skill set or prior work history, accomplishing this ambitious task requires an empathetic understanding of the diverse array of experiences embodied in San Francisco. Your own life experience is a critical contribution to this effort. The Innovation Team is committed to building a team whose diversity reflects the residents we serve. 

How to qualify


An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].


Three (3) years of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of an enterprise network.


Additional experience as described above may be substituted for the required degree on a year-for-year basis (up to a maximum of two (2) years). One (1) year is equivalent to thirty (30) semester units/ forty-five (45) quarter units with a minimum of 10 semester / 15 quarter units in one of the fields above or a closely related field.

Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.

Desirable Qualifications:

Personal Skills

  • Enjoys collaborative processes and developing shared understanding 
  • Ability to communicate with technical and non-technical audiences 
  • Investigative ability and intellectual curiosity 
  • Excellent oral and written communication skills 
  • Ability to learn and embrace new technologies 
  • Demonstrated ability working with diverse groups of stakeholders 
  • Comfort with risk and trying new things 
  • Ability to work independently and as part of a small team 
  • Familiarity with Agile development methodology and experience working in iterative development cycles 
  • Commitment to equity and the use of data to meet the needs of all San Franciscans 

Technical/Knowledge Skills

  • Data Engineering
    • Programming proficiency in Python
    • Strong SQL skills 
    • Experience writing ETL code and/or authoring ETLs through a framework
    • Experience working with a variety of databases, APIs, and formats to extract and transform data
    • Experience deploying code on cloud-based infrastructure (Azure or AWS preferred)
    • Experience training non-technical users to use technology to support their work
  • Analytics
    • Experience in data cleaning and manipulation for analytics use
    • Strong quantitative analysis skills
    • Strong data visualization skills
    • Experience using business intelligence tools (e.g. PowerBI, Tableau) to develop visualizations
  • Data management
    • Well-versed in the principles of open data management
    • Familiarity with open data platforms and/or data catalogs

Bonus points if you have

  • Experience with Snowflake / DBT
  • Familiarity with Microsoft’s Azure Cloud Tools and/or Power BI

What else should I know?

  • Interested candidates are encouraged to apply as soon as possible, as this job announcement will close at any time, but not earlier than February 21, 2024.
  • Late or incomplete submissions will not be considered. Mailed, hand delivered or faxed documents/applications will not be accepted. 
  • For questions or inquiries, please contact: Connie Poon, Senior Human Resources Analyst at 
  • Your application MUST include a resume.  To upload these item, please attach using the "additional attachments" function.

Verification: Applicants may be required to submit verification of qualifying education and experience at any point in the application and/or departmental selection process. Written verification (proof) of qualifying experience must verify that the applicant meets the minimum qualifications stated on the announcement. Written verification must be submitted on employer’s official letterhead, specifying name of employee, dates of employment, types of employment (part-time/full-time), job title(s), description of duties performed, and the verification must be signed by the employer. City employees will receive credit for the duties of the class to which they are appointed. Credit for experience obtained outside of the employee’s class will be allowed only if recorded in accordance with the provisions of the Civil Service Commission Rules. Experience claimed in self-employment must be supported by documents verifying income, earnings, business license and experience comparable to the minimum qualifications of the position. Copies of income tax papers or other documents listing occupations and total earnings must be submitted. If education verification is required, information on how to verify education requirements, including verifying foreign education credits or degree equivalency, can be found at

Note: Falsifying one’s education, training, or work experience or attempted deception on the application may result in disqualification for this and future job opportunities with the City and County of San Francisco. 
Applications will be screened for relevant qualifying experience. Additional screening mechanisms may be implemented in order to determine candidates’ qualifications. Only those applicants who most closely meet the needs of the Agency will be invited to participate in the selection process. Applicants meeting the minimum qualifications are not guaranteed advancement to the interview. Qualified applicants with disabilities requiring reasonable accommodation in the selection process must contact the Agency by phone at (415) 554-6065 or, if hearing impaired at (415) 554-6015 (TTY).

The City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.