Job Description
Job Description
Band: D
Contract type: Permanent
Location: UK Various
Salary £48,000 - £60,000
We're happy to discuss flexible working. Please indicate your choice under the flexible working question in the application.There is no obligation to raise this at the application stage but if you wish to do so, you are welcome to. Flexible working will be part of the discussion at offer stage.
Whether we are looking to improve engagement in iPlayer or Sounds or to improve recommendations in News or Sport app, experimentation helps us make the right decisions for our users.
We are looking for a Senior Experimentation Analyst passionate about experimentation to join our team. You will help us drive the experimentation culture across all products at the BBC. You are confident with statistical analysis, already use data to identify problems most worth solving for product teams, are capable of designing, deploying and analysing product experiments.
You will join a diverse group of highly skilled data analysts, experimentation specialists and product teams that are passionate about driving innovation through scaling experimentation.
You will champion experimental design and methodologies to the rest of the BBC, advance the underlying theory and methods we use, work within the platform to create tools to speed up analysis, as well as find new ways of applying experimentation in a machine learning setting.
Above all, you will play a pivotal role in driving the experimentation culture throughout the company.
Responsibilities
Work closely with product and analytics teams to identify and solve problems through experimentation.
Build, validate and help prioritise the roadmap of tests with data & insights.
Apply experimental design principles to all briefs.
Calculate and communicate baseline conversion rates, sample sizes, MDE, confidence levels and statistical power to product teams
Monitor and validate data quality in running experiments.
Create and communicate experimental findings to product teams and to wider BBC teams
Work with the platforms team to improve the capability of the experimentation platform
Gather, cultivate and research experimentation best practices
Research new methods for experimentation
Create our internal experimentation teaching material
Help the BBC develop procedures for iterating fast while managing risks in a big data environment
Build networks and communities around data informed product development
Advocate the role of experimentation in helping the BBC become a data informed organization.
A community builder, you take an active interest in developing others.
Are you the right candidate?
An undergraduate or MSc degree in Statistics, Computer science or another quantitative field
You have significant practical expertise in experimentation design and analysis methodologies
Solid foundation in causal inference methodology and how to identify causal effects.
Proficient in advanced analytics: statistical hypothesis testing and statistical modelling
Comfortable working with large datasets and well versed in tools such as SQL, Python, R
You have experience with proactively building relationships across organizational boundaries and with multiple stakeholders
You are a strong communicator and can explain sophisticated topics in simple terms.
About the BBC
The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC for different reasons and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk.
We don't focus simply on what we do - we also care how we do it. Our values and the way we behave are important to us. Please make sure you've read about our values and behaviours in the document attached below.
Diversity matters at the BBC. We have a working environment where we value and respect every individual's unique contribution, enabling all of our employees to thrive and achieve their full potential.
We want to attract the broadest range of talented people to be part of the BBC - whether that's to contribute to our programming or our wide range of non-production roles. The more diverse our workforce, the better able we are to respond to and reflect our audiences in all their diversity.
We are committed to equality of opportunity and welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. We will consider flexible working requests for all roles, unless operational requirements prevent otherwise.
Band: D
Contract type: Permanent
Location: UK Various
Salary £48,000 - £60,000
We're happy to discuss flexible working. Please indicate your choice under the flexible working question in the application.There is no obligation to raise this at the application stage but if you wish to do so, you are welcome to. Flexible working will be part of the discussion at offer stage.
- Excellent career progression - the BBC offers great opportunities for employees to seek new challenges and work in different areas of the organisation.
- Unrivalled training and development opportunities - our in-house Academy hosts a wide range of internal and external courses and certification.
- Benefits- We offer a competitive salary package, a flexible 35-hour working week for work-life balance and 26 days (1 of which is a corporation day) with the option to buy an extra 5 days, a defined pension scheme and discounted dental, health care, gym and much more.
Whether we are looking to improve engagement in iPlayer or Sounds or to improve recommendations in News or Sport app, experimentation helps us make the right decisions for our users.
We are looking for a Senior Experimentation Analyst passionate about experimentation to join our team. You will help us drive the experimentation culture across all products at the BBC. You are confident with statistical analysis, already use data to identify problems most worth solving for product teams, are capable of designing, deploying and analysing product experiments.
You will join a diverse group of highly skilled data analysts, experimentation specialists and product teams that are passionate about driving innovation through scaling experimentation.
You will champion experimental design and methodologies to the rest of the BBC, advance the underlying theory and methods we use, work within the platform to create tools to speed up analysis, as well as find new ways of applying experimentation in a machine learning setting.
Above all, you will play a pivotal role in driving the experimentation culture throughout the company.
Responsibilities
Work closely with product and analytics teams to identify and solve problems through experimentation.
Build, validate and help prioritise the roadmap of tests with data & insights.
Apply experimental design principles to all briefs.
Calculate and communicate baseline conversion rates, sample sizes, MDE, confidence levels and statistical power to product teams
Monitor and validate data quality in running experiments.
Create and communicate experimental findings to product teams and to wider BBC teams
Work with the platforms team to improve the capability of the experimentation platform
Gather, cultivate and research experimentation best practices
Research new methods for experimentation
Create our internal experimentation teaching material
Help the BBC develop procedures for iterating fast while managing risks in a big data environment
Build networks and communities around data informed product development
Advocate the role of experimentation in helping the BBC become a data informed organization.
A community builder, you take an active interest in developing others.
Are you the right candidate?
An undergraduate or MSc degree in Statistics, Computer science or another quantitative field
You have significant practical expertise in experimentation design and analysis methodologies
Solid foundation in causal inference methodology and how to identify causal effects.
Proficient in advanced analytics: statistical hypothesis testing and statistical modelling
Comfortable working with large datasets and well versed in tools such as SQL, Python, R
You have experience with proactively building relationships across organizational boundaries and with multiple stakeholders
You are a strong communicator and can explain sophisticated topics in simple terms.
About the BBC
The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC for different reasons and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk.
We don't focus simply on what we do - we also care how we do it. Our values and the way we behave are important to us. Please make sure you've read about our values and behaviours in the document attached below.
Diversity matters at the BBC. We have a working environment where we value and respect every individual's unique contribution, enabling all of our employees to thrive and achieve their full potential.
We want to attract the broadest range of talented people to be part of the BBC - whether that's to contribute to our programming or our wide range of non-production roles. The more diverse our workforce, the better able we are to respond to and reflect our audiences in all their diversity.
We are committed to equality of opportunity and welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. We will consider flexible working requests for all roles, unless operational requirements prevent otherwise.
About BBC