Matt Pfeiffer ᯅ

Matt Pfeiffer ᯅ

@mattpfeiffer.bsky.social

 Platforms Engineer | Audio/Graphics | RealityKit | Metal

990 Followers 716 Following 141 Posts Joined May 2023
3 months ago

Excited to share that I'm joining Apple to work on Immersive Analytics!

Big thank you to everyone who's been engaging with my Vision Pro experiments. I'm really grateful to have the opportunity to keep pushing in this direction career-wise 🙏

23 0 4 0
3 months ago
Preview
PSVR2 Sense Controller Input Handling and Haptics in RealityKit PSVR2 Sense Controller Input Handling and Haptics in RealityKit - ImmersiveSenseControllerInputsView.swift

gist.github.com/Matt54/f0bae...

3 0 0 0
3 months ago
Video thumbnail

RealityKit experiment #86
(code in the replies)

Here's a simple PSVR2 Sense Controller example that handles the inputs, tracks the aim anchor, and triggers haptics

12 4 1 0
4 months ago
Preview
Logitech Muse Anchor Tracking, Model Spawning, and Haptic Feedback (RealityKit) Logitech Muse Anchor Tracking, Model Spawning, and Haptic Feedback (RealityKit) - ImmersiveStylusSimpleExampleView.swift

gist.github.com/Matt54/553b2...

0 0 0 0
4 months ago
Video thumbnail

RealityKit experiment #85
(code in the replies)

I made one more update to my Logitech Muse example to preserve the anchor orientation when spawning the model. Switched to cubes to demonstrate and added a little axis indicator at the aim

10 1 1 0
4 months ago
Preview
Logitech Muse for Apple Vision Pro Tracking, Pressure Sensitive Inputs, and Haptics in RealityKit Logitech Muse for Apple Vision Pro Tracking, Pressure Sensitive Inputs, and Haptics in RealityKit - AppModel.swift

gist.github.com/Matt54/77f73...

1 1 0 0
4 months ago
Video thumbnail

RealityKit experiment #84
(code in the replies)

Here's an update to my Logitech Muse example that handles the pressure values for the tip and secondary button

5 1 1 0
4 months ago
Preview
Logitech Muse Laser Pen Scene Measurement (RealityKit & ARKit) Logitech Muse Laser Pen Scene Measurement (RealityKit & ARKit) - ImmersiveLaserPenMeasurementView.swift

gist.github.com/Matt54/ea591...

4 1 0 0
4 months ago
Video thumbnail

RealityKit experiment #83
(code in the replies)

This example turns the Logitech Muse into a virtual laser pen for point-to-point measurements. The surface intersection point is determined by raycasting along the stylus' aim-origin vector against the scene reconstruction meshes

9 3 1 0
4 months ago
Preview
Logitech Muse for Apple Vision Pro Tracking, Action Buttons, and Haptics in RealityKit Logitech Muse for Apple Vision Pro Tracking, Action Buttons, and Haptics in RealityKit - AppModel.swift

gist.github.com/Matt54/4b22c...

3 1 0 0
4 months ago
Video thumbnail

RealityKit experiment #82
(code in the replies)

Here’s a simple Logitech Muse example that tracks the aim, handles the action buttons, and triggers haptics

8 2 2 0
5 months ago
Preview
PLY to RealityKit with Grid-Based Decimation (Example: HD Skeleton Scan) PLY to RealityKit with Grid-Based Decimation (Example: HD Skeleton Scan) - ModelIOLoader.swift

gist.github.com/Matt54/f001a...

4 1 0 0
5 months ago
Video thumbnail

RealityKit experiment #81
(code in the replies)

I found a scan of a human skeleton and wanted to try to visualize it in RealityKit. The PLY file had millions of triangles, so I had to decimate the mesh. It ended up being really satisfying to see the wireframe at different LODs

7 1 1 0
5 months ago

Thanks Clem! I would love to see that Gaussian Splat example

1 0 0 0
5 months ago
Preview
RealityKit SDF Falling Sand Animation (Metal + LowLevelMesh + Marching Cubes) RealityKit SDF Falling Sand Animation (Metal + LowLevelMesh + Marching Cubes) - EasingCurve.swift

gist.github.com/Matt54/afc92...

1 0 0 0
5 months ago
Video thumbnail

RealityKit experiment #80
(gist in the replies)

LowLevelMesh “Falling Sand” dissolution and reassemble effect created with SDF shapes and Marching Cubes. A Metal compute shader uses a spatial sweep to "release" triangles that rigidly start to fall

9 2 2 0
5 months ago
Preview
RealityKit Extruded Text to LowLevelMesh animated by Metal compute shader RealityKit Extruded Text to LowLevelMesh animated by Metal compute shader - ExtrudedTextLowLevelMeshView.swift

gist.github.com/Matt54/44177...

2 0 0 0
5 months ago
Video thumbnail

RealityKit experiment #79
(code in the replies)

Animating 3D text by converting the output of MeshResource(extruding:) to a LowLevelMesh and applying a Metal compute shader

The MeshResource was interesting to unpack since it had multiple models/parts plus instance transforms

8 1 1 0
5 months ago

Thank you! 🙏

0 0 0 0
5 months ago
Preview
RealityKit Explode and Assemble SDF Shape (Metal + LowLevelMesh + Marching Cubes) RealityKit Explode and Assemble SDF Shape (Metal + LowLevelMesh + Marching Cubes) - EasingCurve.swift

gist.github.com/Matt54/87edc...

3 1 0 0
5 months ago
Video thumbnail

RealityKit experiment #78
(gist in the replies)

LowLevelMesh explode-and-assemble animation created by meshing an SDF using Marching Cubes and rigidly pushing it’s triangles outward

9 3 2 0
6 months ago
Preview
RealityKit Color-Blending Metaballs (Metal + LowLevelMesh + Marching Cubes) RealityKit Color-Blending Metaballs (Metal + LowLevelMesh + Marching Cubes) - MarchingCubesColorBlobParams.h

gist.github.com/Matt54/bcc31...

3 1 0 0
6 months ago
Video thumbnail

RealityKit experiment #77
(gist in the replies)

Color-blending metaballs created from animated sphere SDFs via Marching Cubes. LowLevelMesh vertices store per-vertex color in the Geometry Color vertex attribute, read by ShaderGraphMaterial

8 1 1 0
6 months ago

Ahhh, well I love that description 😆

1 0 0 0
6 months ago

Is it the room?

0 0 1 0
6 months ago
Preview
RealityKit Marching Cubes Blob (Metal + LowLevelMesh) RealityKit Marching Cubes Blob (Metal + LowLevelMesh) - MarchingCubesBlobParams.h

gist.github.com/Matt54/1a506...

3 0 0 0
6 months ago
Video thumbnail

RealityKit experiment #76
(gist in the replies)

LowLevelMesh blob from meshing the smooth-min of animated sphere SDFs with marching cubes. Glassy ShaderGraphMaterial is based on Apple's "Implementing adjustable material" sample

18 3 4 0
6 months ago

Haha exactly 😆

1 0 0 0
7 months ago

gist.github.com/Matt54/aec7d...

1 0 0 0
7 months ago
Video thumbnail

RealityKit experiment #75
(gist in the replies)

LowLevelMesh shape shifting by interpolating between two signed distance fields and meshing with marching cubes

28 6 3 0