Content
Number of images - 8
Tables and charts - 1
Using a Federated Approach to Synthesize Images of Confidential Scene Models L&E, Vol.32, No.4, 2024

Light & Engineering 32 (4) 2024

Volume 32
Date of publication 08/15/2024
Pages 89–102

Purchase PDF - ₽450

Using a Federated Approach to Synthesize Images of Confidential Scene Models L&E, Vol.32, No.4, 2024
Articles authors:
Dmitry D. Zhdanov, Kirill S. Guskov, Andrei D. Zhdanov, Igor S. Potemin, Artemy Yu. Kulbako, Yuri V. Alexandrov, Alexey V. Lopatin, Vadim G. Sokolov

Dmitry D. Zhdanov, Ph. D. (in Physical and Mathematical Sciences). Graduated from the Leningrad Institute of Precision Mechanics and Optics in 1984. Associate Professor at ITMO University, Faculty of Software Engineering and Computer Engineering. Research interests are applied optics, computer graphics, light and engineering

Kirill S. Guskov, software engineer. Graduate student of ITMO University, Faculty of Software Engineering and Computer Engineering. Research interests are computer graphics, software development

Andrei D. Zhdanov, Ph. D. Associate Professor at ITMO University, Faculty of Software Engineering and Computer Engineering. Research interests are computer graphics, virtual prototyping

Igor S. Potemin, Ph. D. Graduated from the Leningrad Institute of Precision Mechanics and Optics in 1984. Associate Professor at ITMO University, Faculty of Software Engineering and Computer Engineering. Research interests are applied optics, computer graphics, light and engineering

Artemy Yu. Kulbako, B. Sc. Graduated from ITMO University with a Bachelor’s degree in Software Engineering. He continues his studies in the same direction in the Master’s degree program at ITMO University. Fullstack is a developer at Softellion. Research interests are computer graphics, web technologies

Yuri V. Alexandrov, B. Sc. Graduated from the Bachelor’s degree of St. Petersburg State Technical University “LETI” in 2021. He is a Master’s student at ITMO University, Faculty of Software Engineering and Computer Technology. Research interests are computer graphics and industrial automation

Alexey V. Lopatin, undergraduate student at ITMO University, research interests are network technologies and high-load systems

Vadim G. Sokolov, Ph. D. Graduated from the Leningrad Institute of Precision Mechanics and Optics in 1994. Researcher at IPM Scientific and Technical Computing Centre LLC. Research interests are computer graphics, applied optics, light and engineer

Abstract:
In some cases, a problem arises related to the synthesis of images of scenes whose data cannot be transferred to the rendering system. This may be due to the secrecy regime and fear of possible data leakage. On the other hand, the rendering system developer may be wary of unlicensed use of the software, resulting in reluctance to supply the software for installation on the customer’s computers. The paper proposes a solution to this problem by isolating the rendering system from the scene data. For this purpose, an object-oriented organization of scene data and the necessary basic scene interfaces are used to organize path tracing methods and light rays. The rendering system itself is divided into two components: the customer’s side and the owner’s side of the rendering system. Only that part of the rendering system is supplied to the customer’s side, which is responsible for the basic methods of the scene model, implemented in the form of services used by the owner of the rendering system. Client-side services, in accordance with scene interfaces, perform basic operations with scene data and rays without transferring the entire result to the rendering system, which, in turn, manages the rendering process using metrics and the minimum necessary intermediate data received from the client side. Thus, the scene data and the rendered image remain with the client, and the rendering process is managed by the developer’s server. Naturally, the interaction between the client and the rendering system slows down the calculation process, but the image quality does not decrease, and the data is not transferred anywhere. The article presents the rendering results for a few scenes using a federated approach to image synthesis.
References:
1. Kajiya, J.T. The rendering equation // Proceedings of the 13th annual conference on Computer graphics and interactive techniques, 1986, pp. 143–150.
2. Pharr, M., Jakob, W., Humphreys, G. Physically Based Rendering: From Theory to Implementation (3rd. ed.) / Morgan Kaufmann Publishers, 2016.
3. Bogolepov, D., Ulyanov, D., Sopin, D., Turlapov, V. GPU-Optimized Bidirectional Path Tracing // The 21st International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, 2013, pp. 1–15.
4. Veach, E. Robust Monte Carlo methods for light transport simulation. PhD thesis. – Stanford University, 1998.
5. Jensen, H.W. Global illumination using photon maps // Rendering Techniques’ 96: Proceedings of the Eurographics Workshop in Porto, Portugal, June 17–19, 1996 7, Springer Vienna, 1996, pp. 21–30.
6. Hachisuka, T., Jensen, H.W. Stochastic progressive photon mapping // ACM SIGGRAPH Asia 2009 papers, 2009, Vol. 28, # 5, pp. 1–8.
7. Kaplanyan, A. S., Dachsbacher, C. Adaptive progressive photon mapping // ACM Transactions on Graphics (TOG), 2013, Vol. 32, # 2, pp. 1–13.
8. Zhdanov, A.D., Zhdanov, D.D. Progressive Backward Photon Mapping // Programming and Computer Software, 2021, Vol. 47, # 3, pp. 185–193.
9. Zhdanov, A., Zhdanov, D., Galaktionov, V.A. Bidirectional Ray Tracing with Caustic Photon and Indirect Imphoton Maps // Proceedings of the 14th IADIS International Conference Computer Graphics, Visualization, Computer Vision and Image Processing 2020, CGVCVIP 2020 and Proceedings of the 5th IADIS International Conference Big Data Analytics, Data Mining and Computational Intelligence 2020, BigDaCI 2020 and Proceedings of the 9th IADIS International Conference Theory and Practice in Modern Computing 2020, TPMC 2020 – Part of the 14th Multi Conference on Computer Science and Information Systems, MCCSIS 2020, 2020, pp. 212–216.
10. Georgiev, I., Krivanek, J., Davidovic, T., Slusallek, P. Light Transport Simulation with Vertex Connection and Merging // ACM Transactions on Graphics, 2012, Vol. 31, # 6, pp. 1–10.
11. Hachisuka, T., Pantaleoni, J., Jensen, H.W. A path space extension for robust light transport simulation // ACM Transactions on Graphics, 2016, Vol. 31, # 6, pp. 1–10.
12. Křivánek, J. et al. Unifying points, beams, and paths in volumetric light transport simulation // ACM Transactions on Graphics (TOG), 2014, Vol. 33, # 4, pp. 1–13.
13. Frolov, V.A., Voloboy, A.G., Ershov, S.V., Galaktionov, V.A. Light transport in realistic rendering: state-ofthe-art simulation methods // Programming and Computer Software, 2021, Vol. 47, # 4, pp. 298–326.
14. Ghoshal, S., Kermarrec, A.M., Taıani, F. Distributed computing for the masses: a manifesto // Communications of the ACM, 2019, Vol. 62, # 11, pp. 36–41.
15. Dean, J., Ghemawat, S. MapReduce: simplified data processing on large clusters // Communications of the ACM, 2008, Vol. 51, # 1, pp. 107–113.
16. Zaharia, M. et al. Spark: Cluster computing with working sets // 2nd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 10), 2010.
17. GitHub – embree/embree: Embree ray tracing kernels repository. URL: https://github.com/embree/embree (дата обращения: 24.03.2024).
18. Intel® oneAPI Threading Building Blocks. URL: https://www.intel.com/content/www/us/en/developer/ tools/oneapi/onetbb.html (дата обращения: 24.03.2024).
19. gRPC. URL: https://grpc.io (дата обращения: 24.03.2024).
Keywords

Buy

Recommended articles