Skip to content
Blog

Spatial Computing with Flutter: Running 2D and 3D Windows on Apple Vision Pro (visionOS)

Exploring visionOS embedder ports for Flutter, spatial interaction paradigms, glassmorphism, and 3D UI rendering on Apple Vision Pro.

Published on • October 24, 2026

RedLineSoft Team

Apple’s Vision Pro introduced spatial computing, blending digital content with physical environments. As developers look to deploy cross-platform apps to visionOS, community-led embedders and metal-level engine integration have enabled Flutter applications to run as spatial 2D windows and 3D volume surfaces in visionOS.

In this article, we explore how Flutter adapts to spatial computing interaction models.

How Flutter Runs on visionOS

Apple visionOS applications combine standard SwiftUI 2D windows with RealityKit 3D volumes and immersive spaces.

Flutter integrates with visionOS using two execution modes:

  1. Compatible iOS Mode: Runs existing Flutter iOS builds in a floating 2D spatial window. The visionOS system translates eye-tracking gaze and pinch gestures into simulated touch events automatically.
  2. Native visionOS Embedder Mode: Uses a custom Swift/Metal embedder targeting xros (visionOS SDK). Flutter renders directly into a native UIKit / SwiftUI spatial view container.
+-------------------------------------------------------------+
|              Spatial User Interface (visionOS)              |
|   +-----------------------------------------------------+   |
|   |         Flutter Metal Surface (Engine Target)       |   |
|   |  - Eye Gaze Hovering Signals                        |   |
|   |  - Spatial Pinch & Drag Gestures                    |   |
|   +-----------------------------------------------------+   |
+-------------------------------------------------------------+

Spatial Design Adaptations for Flutter

Building compelling spatial experiences requires adjusting UI paradigms to suit eye-tracking and distance interaction:

1. Spatial Touch & Hover Targets

On visionOS, users select elements by looking at them and pinching their fingers. Touch targets require minimum dimensions of 44x44pt with generous padding to prevent eye-gaze selection fatigue:

// Applying spatial interaction padding and hover feedback
MouseRegion(
  onEnter: (_) => setState(() => _isGazeHovered = true),
  onExit: (_) => setState(() => _isGazeHovered = false),
  child: AnimatedContainer(
    duration: const Duration(milliseconds: 150),
    padding: const EdgeInsets.all(16.0),
    decoration: BoxDecoration(
      color: _isGazeHovered ? Colors.white.withOpacity(0.2) : Colors.transparent,
      borderRadius: BorderRadius.circular(12.0),
    ),
    child: const Text('Spatial Action'),
  ),
)

2. Glassmorphism & Translucent Backdrop Materials

visionOS windows rely heavily on translucent, light-reactive background materials so physical surroundings remain visible. Flutter’s BackdropFilter and Blur widgets recreate glassmorphism effects matching native system aesthetics.

3. Integrating 3D Assets with Flutter GPU

For spatial apps that mix 2D Flutter controls with 3D models, developers can use Flutter GPU (Impeller’s low-level shader layer) or bridge native RealityKit scenes into Flutter platform view slots.

The Future of Cross-Platform Spatial Apps

As AR/VR hardware becomes more accessible, cross-platform frameworks capable of deploying unified UI code across mobile, web, desktop, and spatial headsets give development teams a major advantage.

References & Further Reading