Interactive 2D game with augmented reality and real-time object recognition

Author: BERNARD STRČIĆ, MARKO MARIČEVIĆ, TIBOR SKALA

Company/Institution: Grafički fakultet

Country: CROATIA

e-mail: Marko.maricevic@grf.unizg.hr

web: www.grf.unizg.hr

An interactive 2D augmented reality web game allows the user to physically place stickers or markers in space (e.g. on a magnetic board), which the camera recognizes in real time via computer vision and color detection and automatically converts into virtual platforms within the game. The solution is based on web technologies without additional applications, with React for the user interface, Express for communication, and Python and OpenCV for image processing; detection is based on HSV calibration and perspective transformation, and positional data is stored in JSON and loaded dynamically without refreshing the page. The system includes collision detection, camera scaling to the dimensions of the game, and calibration tools in different lighting conditions, which achieves a robust and accessible integration of physical and digital elements and broadens the accessibility of augmented reality through simple web implementation.