Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Privacy Pro Free Trials Experiment #5686

Merged
merged 16 commits into from
Mar 1, 2025

Conversation

nalcalag
Copy link
Contributor

@nalcalag nalcalag commented Feb 25, 2025

Task/Issue URL: https://app.asana.com/0/72649045549333/1208886381764923

Description

Free Trial experiment implementation

Steps to test this PR

Pre steps

  • Apply Privacy Pro patch to be eligible
  • Point privacy config to https://jsonblob.com/api/1339653006785961984 which has the experiment available
    - If you want the treatment variant to be always assigned, change the weight of the control cohort to 0 for privacyProFreeTrialJan25 feature.
    - If you want the control variant to be always assigned, change the weight of the treatment cohort to 0 for privacyProFreeTrialJan25 feature.

Privacy Pro ROW

  • Force control cohort to be assigned (see pre steps)
  • Fresh install
  • Go to Settings, and tap on Privacy Pro which will display the paywall screen
  • Check you see the current products full price
  • Check you can buy monthly correctly
  • Check Subscription Settings screen is showing status/renewal dates correctly
  • Cancel subscription
  • Check Subscription Settings screen is showing status/expire dates correctly
  • Wait until it expires
  • Check Subscription Settings screen is showing status/expired state correctly

Control cohort (US)

  • Set a US Google account
  • Force control cohort to be assigned (see pre steps)
  • Fresh install
  • Go to Settings, and tap on Privacy Pro which will display the paywall screen
  • Check pixel experiment_enroll_privacyProFreeTrialJan25_control is fired
  • Check you see the current products full price
  • Check you can buy monthly correctly
  • Check Subscription Settings screen is showing status/renewal dates correctly
  • Cancel subscription
  • Check Subscription Settings screen is showing status/expire dates correctly
  • Wait until it expires
  • Check Subscription Settings screen is showing status/expired state correctly

Treatment cohort (US)

  • Set a US Google account
  • Force treatment cohort to be assigned (see pre steps)
  • Fresh install
  • Go to Settings, and tap on Privacy Pro which will display the paywall screen
  • Check pixel experiment_enroll_privacyProFreeTrialJan25_treatment is fired
  • Check pixel Pixel sent: experiment_metrics_privacyProFreeTrialJan25_treatment with params: {metric=paywallImpressions, value=1.. is fired
  • Check you see the free trial products on paywall
  • Select monthly product
  • Check pixel experiment_metrics_privacyProFreeTrialJan25_treatment with params: {metric=startClickedMonthly.. is fired
  • Check you can buy the free trial correctly
  • Check pixel experiment_metrics_privacyProFreeTrialJan25_treatment with params: {metric=subscriptionStartedMonthly... is fired
  • Check Subscription Settings screen is showing status/renewal dates correctly for Free Trial
  • Cancel subscription (when still on Free Trial)
  • Check Subscription Settings screen is showing status/expire dates correctly for Free Trial
  • Wait until it expires
  • Check Subscription Settings screen is showing status/expired state correctly
  • Go to Paywall again
  • Check you are offered full price subscriptions

UI changes

Control Treatment
Screenshot 2025-02-26 at 11 10 41
Screenshot 2025-02-26 at 11 23 47
control-renew control-renew
control-cancelled treatment-cancelled

@nalcalag
Copy link
Contributor Author

nalcalag commented Feb 25, 2025

This stack of pull requests is managed by Graphite. Learn more about stacking.

@nalcalag nalcalag force-pushed the feature/noelia/free_trial_experiment_cohorts branch 4 times, most recently from 018dcf9 to cba287e Compare February 26, 2025 14:37
@lmac012 lmac012 self-assigned this Feb 26, 2025
@lmac012 lmac012 self-requested a review February 26, 2025 22:11
@nalcalag nalcalag force-pushed the feature/noelia/free_trial_experiment_cohorts branch from cba287e to 1a9b61e Compare February 27, 2025 09:57
@nalcalag nalcalag force-pushed the feature/noelia/free_trial_experiment_cohorts branch from 1a9b61e to 31ddc53 Compare February 27, 2025 17:46
Task/Issue URL: 

### Description

### Steps to test this PR

_Feature 1_
- [ ]
- [ ]

### UI changes
| Before  | After |
| ------ | ----- |
!(Upload before screenshot)|(Upload after screenshot)|
@nalcalag nalcalag marked this pull request as ready for review February 27, 2025 20:50
…subscriptions/impl/freetrial/FreeTrialExperimentDataStore.kt

Co-authored-by: Lukasz Macionczyk <[email protected]>
Copy link
Contributor

@lmac012 lmac012 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good and works as expected 👏

@nalcalag nalcalag merged commit 991fb60 into develop Mar 1, 2025
9 checks passed
@nalcalag nalcalag deleted the feature/noelia/free_trial_experiment_cohorts branch March 1, 2025 00:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants