METHOD FOR FORMING A/B TEST GROUPS WITH MINIMAL INTERFERENCE USING THE STOER–WAGNER ALGORITHM

Keywords: A/B testing, spillover effect, clustering, geo-randomization, behavioral grouping.

Abstract

This article examines contemporary methods for constructing experimental groups in A/B testing for digital products, with a specific focus on minimizing mutual interference between participants and reducing spillover effects arising from social or behavioral interactions. The challenge of uncontrolled user-to-user influence has grown increasingly important in highly con- nected online environments, where actions, recommendations, and shared content can propagate across a network and distort the measured impact of an experimental treatment. Such interference undermines the validity of causal inference and often leads to biased or unstable conclusions about product performance. The paper provides an overview of established approaches, including cluster-based randomization, geographic exper- iments, and hierarchical assignment strategies, as well as practical implementations widely adopted by leading technology companies such as Meta and Google. These organizations regularly face large-scale network effects and have developed robust methodologies to ensure reliable experimentation even when user interactions cannot be ignored. A central contribution of the article is the introduction of a graph-based method for constructing experimental groups. In this approach, users are represented as nodes within an interaction graph, and the strength of their connections reflects the probability or intensity of potential interference. Group formation is achieved through identifying a minimum cut in this graph, computed using the Stoer–Wagner algorithm. This algorithm enables efficient and scalable partitioning of large networks while guaranteeing an optimally minimal sum of cross-group connections. As a result, the proposed method effectively reduces spillo- ver effects and significantly improves the internal validity of A/B tests. The advantages of minimum-cut partitioning include natural alignment with real-world interaction patterns, suitability for graphs containing millions of users, reduced risk of contamination between treatment and control groups, and consist- ency with experimentation frameworks observed in industry practice. These benefits underscore the relevance and applicability of graph-based experimental design for modern digital ecosystems.

References

1. Xu Y. From Infrastructure to Culture: A/B Testing Challenges in Large Scale Social Networks / Xu Y., Nanyu Ch., Fernandez A., Sinno O., Bhasin A. 2015. URL: https://dl.acm.org/doi/abs/10.1145/2783258.2788602
2. Holmström Olsson H. Experimentation that Matters: A Multi-case Study on the Challenges with A/B Testing. Holmström Olsson H., Bosch J., Fabijan A. 2017. URL: https://link.springer.com/chapter/ 10.1007/978-3-319-69191-6_12
3. Vaver J. Measuring Ad Effectiveness Using Geo Experiments. Vaver J., Koehler J. Google. URL: https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/38355.pdf
4. Kerman J. Estimating Ad Effectiveness using Geo Experiments in a Time-Based Regression Framework. Kerman J., Wang P., Vaver J. Google. URL: https://static.googleusercontent.com/media/research.google.com/en// pubs/archive/45950.pdf
5. Karrer B. Network experimentation at scale. Karrer B., Shi L., Bhole M., Goldman M., Palmer T., Gelman C., Konutgan M., Sun F. Cornell University, 2020. URL: https://arxiv.org/abs/2012.08591
6. Karypis G. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. Karypis G., Kumar V. SIAM Journal on Scientific Computing. 1998. Т. 20, № 1. С. 359–392. https://doi.org/10.1137/ S1064827595287997
7. Blondel V. D. Fast Unfolding of Communities in Large Networks. Blondel, V. D., & Guillaume, J. L. Journal of Statistical Mechanics. 2008. Режим https://doi.org/10.1088/1742-5468/2008/10/P10008
8. How Meta tests products with strong network effects. URL: https://medium.com/%40AnalyticsAtMeta/ how-meta-tests-products-with-strong-network-effects-96003a056c2c.
9. Testing Product Changes with Network Effects. URL: https://research.facebook.com/blog/2021/8/testing- product-changes-with-network-effects
10. Stoer M. A simple min-cut algorithm. / Stoer M., Wagner F. Journal of the ACM. 1997. Т. 44, № 4. С. 585–591. https://doi.org/10.1145/263867.263872
Published
2026-01-27
How to Cite
Kramar, Y. M., Vitkovska, I. I., Zharikov, E. V., & Radionov, P. Y. (2026). METHOD FOR FORMING A/B TEST GROUPS WITH MINIMAL INTERFERENCE USING THE STOER–WAGNER ALGORITHM. Systems and Technologies, 71(1), 68-72. https://doi.org/10.32782/2521-6643-2026-1-71.9
Section
COMPUTER SCIENCES