Career Opportunity

DIRECTOR OF DATA, ANALYTICS, AND EVALUATION (0923 Manager II)

Recruitment: RTF0130720-01148558

Published: February 03, 2023

Apply using SmartRecruiters, the City and County of San Francisco's application portal Learn More

About:

APPLICATION OPENING:  January 19, 2023

**Interested applicants are encouraged to apply immediately as this job ad may close at any time but no sooner than February 3, 2023.**

This is a Position-Based Test conducted in accordance with Civil Service Rule 111A.

Compensation Range: $131,248 and $167,492 annually. For more details see
comp and class.

The Department of Public Health is accepting applications for a Director of Data, Analytics, and Evaluation (0923 Manager II).

Role description

POSITION DESCRIPTION:

The Director of Data, Analytics, and Evaluation (0923 Manager II) within the Quality Management (QM) Unit reports to the Director of Quality Management & Regulatory Affairs and is responsible for the vision, oversight and setting direction for all analytic activities and projects that involve program monitoring and evaluation, quality improvement data analysis, and research activities. This position will supervise, train, evaluate, and coach program staff; assess and build resources for the unit including access to information, training, and technical assistance as needed; provide reports and presentations on behalf of QM, and collaborate with internal and external stakeholders. The QM Office of Data, Analytics, and Evaluation is made up of the following teams: Mental Health San Francisco (MHSF) Analytics & Evaluation; QM Analytics; and Data Stewardship.

ESSENTIAL DUTIES:
The Director of Data, Analytics, and Evaluation (0923 Manager II) performs the following essential functions:

1. Directs Mental Health SF (MHSF) Analytics & Evaluation; QM Analytics; and Data Stewardship, including the following activities:
   • Provides oversight and direction to QM analytic teams, including setting analytic and project priorities; supporting teams with analytic guidance; and engaging with analytic teams from across DPH to coordinate data sharing, project prioritization, and shared analytic approaches.
   • Plans trainings for the QM analytic teams and provides direction and support as they transition to a new electronic health record (Epic) that will be used to conduct analyses for outcome and quality measures and reporting; represents QM during the Epic implementation and go live process
   • Provides oversight for the tracking, monitoring, and reporting of Mental Health Medi-Cal and Drug Medi-Cal performance measures, including client outcomes and consumer surveys.
   • Provides oversight for Mental Health Services Act Data Collection and Reporting metrics, and guides evaluation of Innovations and other MHSA funded programs.
   • Collaborates with the Quality Management Director and QI Coordinators to design, implement, and support team to produce data needed for quality improvement projects.
   • Supports teams to develop, monitor, and report key Divisional and other performance metrics, including using data visualization techniques for Mental Health SF and other key initiatives. 
   • Supports standardization of data collection and reporting, including setting or maintaining data quality and validation processes as needed.
   • Evaluates and continuously improves data analysis, reporting, and visualization workflows and processes, implementing tests of change and standard work to ensure workflows result in timely, accurate, equitable, and standardized data and reporting.
   • Manages the timely and accurate response to data requests for internal and external audits and reviews.
   • Provides technical assistance in the development of contract performance objectives.
2. Trains, evaluates, and coaches the work of seventeen (17) staff, including the supervision of three (3) direct reports.
3. Assesses capacity building needs within the unit, and provides access to information, training, and technical assistance as needed.
4. Prepares and delivers reports and presentations in service of the goals of the QM Data, Analytics, and Evaluation unit, including presentations to leadership teams within Behavioral Health Services, MHSF, and the Department of Public Health.
5. Coordinates with stakeholders across DPH and other partner entities to implement data exchange and data sharing goals and objectives, as required by CalAIM.
6. Uses Lean and other QI tools to develop efficient and effective processes to meet agency goals.

The Director of Data, Analytics, and Evaluation (0923 Manager II) performs other duties as assigned or required.

How to qualify

REQUIRED MINIMUM QUALIFICATIONS:
All candidates must verify that they meet both elements below—education and experience that includes all types of experience listed in healthcare.

1. EDUCATION: Possession of bachelor’s degree from an accredited college or university;
   
   AND
   
   2.    EXPERIENCE: Three (3) years of verifiable full-time professional experience working for a behavioral health, public health, or related agency with responsibility for program analytics, data, reporting or evaluation.

EDUCATION SUBSTITUTION: Additional verifiable professional experience may substitute for the bachelor’s degree on a year-for-year basis up to a maximum of two (2) years. One year is equal to thirty (30) semester or forty-five (45) quarter units.

Note: One year of full-time employment is equivalent to 2,000 hours of qualifying work experience (one year if performed full-time at 40 hours per week). Any overtime hours that were worked above 40 hours per week are not included in the calculation to determine qualifying hours worked.

Applicants must meet the minimum qualification requirements by the final filing date unless otherwise noted.

DESIRED QUALIFICATIONS
The stated desired qualifications listed below may be used to identify job finalists at the end of the selection process after candidates are referred for selection:

• Two (2) years of supervisory experience
• Bachelor’s degree with coursework in epidemiology, research psychology, statistics, and/or information systems
• Graduate degree in Psychology, Social Work, Program Evaluation, Epidemiology or a closely related field.
• Demonstrated managerial experience
• Demonstrated experience overseeing the production of data visualizations using Power BI or Tableau
• Demonstrated experience managing regulatory and quality reporting processes on behalf of Medi-Cal beneficiaries
• Familiarity with Avatar and/or Epic advanced reporting tools
• Demonstrated experience with presenting data analytic reports to diverse audiences, including front line staff and upper management.

Note: Falsifying one's education, training, or work experience or attempted deception on the application may result in disqualification for this and future job opportunities with the City and County of San Francisco.

Verification of Education
Verification of Experience

SELECTION PROCEDURES

Minimum Qualification Supplemental Questionnaire (MQSQ) (Weight: Qualifying): Applicants will be required to complete a Minimum Qualification Supplemental Questionnaire by email after your submit your application. This MQSQ is designed to obtain specific information regarding an applicant's experience in relation to the Minimum Qualifications for this position. Applicants must also complete the official application. It is essential that applicants provide complete information identifying their education, experience, and training. The MQSQ will be used to evaluate if the applicant possesses the required minimum qualifications.

Supervisory Test Battery (Weight: 40%): Candidates will be invited to participate in a computer-based examination designed to measure competencies in job-related areas which may include but not be limited to: Problem Solving; Leadership; Decision Making; Interpersonal skill; Human Resource Management; Team Building; Communication, Conflict Management and Process Improvement. For more information about this Supervisory Test (and a suggested reading list) please visit Supervisory Test Battery info Please note: this examination is only held in San Francisco. A passing score must be achieved on the Supervisory Test Battery to continue in the selection process. This is a standardized examination and, therefore, test questions and answers are not available for public inspection or review. Scores attained on the Supervisory Test Battery will be valid and 'banked' for three years, starting from the date of the examination. This means that, during this three-year time period, you will not be required to take the Supervisory Test Battery. The Supervisory Test Battery may be used for many other classes; therefore, your test score may be applied to one or more of these classes if you choose to apply to future recruitments. If the selection process for the future announcement is held within one year of the date of this examination and it includes the Supervisory Test Battery, your score will be automatically applied to that announcement. However, after one year, you have the option to either (a) apply your test score to the other announcement or (b) re-take the Supervisory Test Battery. Retesting is permitted no sooner than one year from the date of the examination and only in association with your eligibility for another announcement for which the Supervisory Test Battery is used. Please note that, should you re-test, your re-test score would become your official score since it is the most recent.  

Supplemental Questionnaire (SQ) Examination (Weight: 60%): Candidates who achieve a passing score on the Supervisory Test Battery (STB) will be emailed a Supplemental Questionnaire (SQ) that is designed to measure the knowledge, skills, and abilities in job related areas which may include but not be limited to leadership capabilities, supervision skills, and technical skills such as program evaluation theory and design methodology, qualitative and quantitative analysis, and quality improvement tools. The SQ link will be emailed to the address listed on the candidate’s online application. Candidates will be required to respond to the SQ in the time frame indicated and must submit the completed questionnaire as directed in order to have it evaluated. Responses cannot be changed once submitted. Candidates will be evaluated based on their SQ responses. Candidates must achieve a passing score on the SQ in order to continue in the selection process and will be placed on the confidential eligible list in rank order according to their final score. A passing score must be achieved on each of the above-described exams in order to be included on the confidential eligible list. After the confidential eligible list is adopted the department may administer additional selection procedures to make a final hiring decision.  

Eligible List/Score Report: 
A confidential eligible list of applicant names that have passed the civil service examination process will be created and used for certification purposes only. The duration of the eligible list resulting from this examination process will be of six (6) months and may be extended with the approval of the Human Resources Program Director. 

Certification: The certification rule for the eligible list resulting from this examination will be Rule of the List. Additional selection processes may be conducted by the hiring department prior to making final hiring decisions.

What else should I know?

Exam Type: Combined Promotive and Entrance (CPE)

Confidentiality: All personal information will be kept confidential according to EEO guidelines.

Licensure/Certification/Registration: Valid, unrestricted licensure/certification/registration as a requirement to perform this job must be kept current throughout length of employment. Failure to demonstrate/show proof of possession of required valid licensure/certification/registration may result in dismissal and/or termination of employment.

Note on Electronic Health Record (EHR): The Department of Public Health (DPH) is implementing a unified Electronic Health Record (EHR) system and DPH employees must demonstrate competency in the use of the system that is appropriate for their classification as a condition of employment. Note on  

Personal Protective Equipment (PPE): Some positions in the Department of Public Health will require the use of personal protective equipment (PPE), including but not limited to gloves, gowns, eye and face protection, and face-fitting respirators. The requirement for the use of PPE may come on short or no notice. Facial hair or any condition that interferes with a face-fitting respirator’s seal (i.e. comes between the sealing surfaces of the respirator and the wearer’s bare skin) is not permitted when face-fitting respirators are worn, including during initial or periodic respirator fit-testing. Employees who choose not to shave and do not have either American Disabilities Act (ADA) or Equal Employment Opportunity (EEO) Accommodations do not have the right to alternate work assignments or the option of using a loose-fitting Powered Air Purifying Respirator (PAPR) in place of a Face Fitting Respirator.  

Medical Examination/Drug Testing:
Prior to appointment, at the Department's expense, applicants may be required to take a tuberculosis (TB) screening test, a medical examination and/or drug test.

Terms of Announcement:
Applicants must be guided solely by the provisions of this announcement, including requirements, time periods and other particulars, except when superseded by federal, state or local laws, rules or regulations. Clerical errors may be corrected by the posting the correction on the Department of Human Resources website. The terms of this announcement may be appealed under Civil Service Rule 111A.35.1. 

Equity, Diversity, and Inclusion:
All employees are required to participate in the Department of Public Health's work in equity, diversity, and inclusion through:

• Commitment to providing first-class care and service to all members of the DPH service population, with heightened sensitivity and awareness to racial, ethnic, and culturally diverse members of the DPH’s workforce and patient populations.
• Desire and commitment to lead and participate in antiracism, racial justice, and equity work that impacts quality of patient care, and improvements in employee experiences; along with the commitment and fortitude to push and drive change in these areas.
• Desire to work with, relate to, serve, and support a diverse workforce and patient population.
• Commitment to health equity with a specific lens and focus on race, ethnicity, gender, sex, and sexuality.

Other useful information:

• Conviction History
• Benefits Overview
• Disaster Service Workers
• General Information concerning City and County of San Francisco Employment Policies and Procedures
• Information on requesting a reasonable ADA Accommodation
• Veteran's Preference
• Seniority Credit in Promotional Exams
• Copies of Application Documents\
• Right to Work

We may use text messaging to communicate with you if you include a mobile number in your application. The first message will ask you to opt in to text messaging.

Exam Analyst
Beata Chapman
beata.chapman@sfdph.org
628-271-6701
/01148558

CONDITION OF EMPLOYMENT:  All City and County of San Francisco employees are required to be fully vaccinated against COVID-19 as a condition of employment. Someone is fully vaccinated when 14 days have passed since they received the final dose of a two-shot vaccine or a dose of a one-shot vaccine. Any new hire must present proof of full vaccination status to be appointed. Any new hire who will be routinely assigned or occasionally enter High-Risk Settings, must provide proof of having received a COVID-19 booster vaccine by March 1, 2022, or once eligible.

The City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.