Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Solved
  • Unsolved
  • Users
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
brainCloud Forums
  1. Home
  2. General
  3. Discussion - A/B Testing

Discussion - A/B Testing

Scheduled Pinned Locked Moved Unsolved General
ab testingtesting
5 Posts 2 Posters 1.3k Views 2 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • F Offline
    F Offline
    francesco.lenolli
    wrote on last edited by
    #1

    Hello,
    We're exploring how to do A/B Testings in our apps using Braincloud, but as far I can tell support for this is very limited. I can see that each user is assigned an A/B Test ID but I can find any info on what we can do with it out of the box, the key feature we need is the ability to group users together based on custom criteria or segments and I don't see an option for that.
    Talking with the chatbot it suggested the use of Groups, but they seem limited to about 50 people and are more intended for clans, teams and related game mechanics.

    Any additional information on this topic will be much appreciated.

    1 Reply Last reply
    0
    • J Offline
      J Offline
      JasonL
      bitHeads
      wrote on last edited by
      #2

      On the A/B testing side, each user is assigned a unique A/B test ID (0–99) when their account is created. These IDs can be used to segment players for different testing experiments, and are available as criteria within our Segment system. The abTestingId is returned to the app as part of the authentication response, and can also be accessed via the PlayerStats.ReadUserState() call.17559005-7b3f-4212-90e7-9b24cd706da7-image.png

      F 1 Reply Last reply
      0
      • J JasonL

        On the A/B testing side, each user is assigned a unique A/B test ID (0–99) when their account is created. These IDs can be used to segment players for different testing experiments, and are available as criteria within our Segment system. The abTestingId is returned to the app as part of the authentication response, and can also be accessed via the PlayerStats.ReadUserState() call.17559005-7b3f-4212-90e7-9b24cd706da7-image.png

        F Offline
        F Offline
        francesco.lenolli
        wrote on last edited by
        #3

        @JasonL
        Thank you for the info on the test ID. Speaking of segments, Is there a way to limit the amount of users that can fit in a segment? For example, what if I want my test group to be exactly 10k users?

        1 Reply Last reply
        0
        • J Offline
          J Offline
          JasonL
          bitHeads
          wrote on last edited by
          #4

          There’s no direct way to cap the exact number of users in a segment, but you can add more criteria with the testing ID to narrow it down?

          F 1 Reply Last reply
          0
          • J JasonL

            There’s no direct way to cap the exact number of users in a segment, but you can add more criteria with the testing ID to narrow it down?

            F Offline
            F Offline
            francesco.lenolli
            wrote on last edited by
            #5

            @JasonL
            Yes we can do that too, I was just wondering how granular our control over the segment is, as one of the requirements for our testing was to have a precise number of users for each group.

            Thank you so much for the info, I'll write again if I have more questions.

            1 Reply Last reply
            0

            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

            With your input, this post could be even better 💗

            Register Login
            Reply
            • Reply as topic
            Log in to reply
            • Oldest to Newest
            • Newest to Oldest
            • Most Votes


            • Login

            • Login or register to search.
            • First post
              Last post
            0
            • Categories
            • Recent
            • Tags
            • Popular
            • Solved
            • Unsolved
            • Users