Wenzel Jakob's Avatar

Wenzel Jakob

@wjakob.bsky.social

Associate professor leading EPFL's Realistic Graphics Lab. My research involves inverse graphics, material appearance modeling and physically based rendering

1,370 Followers  |  215 Following  |  45 Posts  |  Joined: 16.12.2023  |  1.794

Latest posts by wjakob.bsky.social on Bluesky

You can dump the PTX intermediate representation (see the documentation), but figuring out the calling convention of the kernel for your own use will be tricky. The system is not designed to be used in this way.

22.08.2025 10:36 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Just write your solver in plain CUDA. How hard can it be? ๐Ÿ˜›

18.08.2025 19:33 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

This approach is restricted to software that only needs the CUDA driver. If your project uses cuSolver, you will likely need to have a dependency on the CUDA python package that ships this library on PyPI (similar to PyTorch et al.)

18.08.2025 19:09 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

Differentiable rendering has transformed graphics and 3D vision, but what about other fields? Our SIGGRAPH 2025 introduces misuka, the first fully-differentiable path tracer for acoustics.

12.08.2025 19:26 โ€” ๐Ÿ‘ 81    ๐Ÿ” 14    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Wasnโ€™t that something.. Flocke (German for โ€œflakeโ€) says hi!

15.08.2025 04:45 โ€” ๐Ÿ‘ 5    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

If you are fitting a NeRF and you want a surface out at the end, you should probably be using the idea in this paper.

12.08.2025 06:43 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Given the focus on performance, I would suggest to switch from pybind11 to nanobind. Should just be a tiny change ๐Ÿ˜‡

11.08.2025 15:05 โ€” ๐Ÿ‘ 5    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Mokume

For the paper and data, please check out the project page: mokumeproject.github.io

08.08.2025 11:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
The Mokume Dataset and Inverse Modeling of Solid Wood Textures (Technical Paper, SIGGRAPH 2025)
YouTube video by Maria Larsson The Mokume Dataset and Inverse Modeling of Solid Wood Textures (Technical Paper, SIGGRAPH 2025)

This video explains the process more detail: www.youtube.com/watch?v=H6N-...

08.08.2025 11:53 โ€” ๐Ÿ‘ 3    ๐Ÿ” 1    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

The Mokume project is a massive collaborative effort led by Maria Larsson at the University of Tokyo (w/Hodaka Yamaguchi, Ehsan Pajouheshgar, I-Chao Shen, Kenji Tojo, Chia-Ming Chang, Lars Hansson, Olof Broman, Takashi Ijiri, Ariel Shamir, and Takeo Igarashi).

08.08.2025 11:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

To reconstruct their interior, we: 1๏ธโƒฃLocalize annual rings on cube faces 2๏ธโƒฃ Optimize a procedural growth field that assigns an age to every 3D point (when that wood formed during the tree's life) 3๏ธโƒฃ Synthesize detailed textures via procedural model or a neural cellular automaton

08.08.2025 11:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

The Mokume dataset consists of 190 physical wood cubes from 17 species, each documented with:

- High-res photos of all 6 faces
- Annual ring annotations
- Photos of slanted cuts for validation
- CT scans revealing the true interior structure (for future use)

08.08.2025 11:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

Wood textures are everywhere in graphics, but realistic texturing requires knowing what wood looks like throughout its volume, not just on the surfaces.
The patterns depend on tree species, growth conditions, and where and how the wood was cut from the tree.

08.08.2025 11:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

How can one reconstruct the complete 3D interior of a wood block using only photos of its surfaces? ๐Ÿชต
At SIGGRAPH'25 (Thursday!), Maria Larsson will present *Mokume*: a dataset of 190 diverse wood samples and a pipeline that solves this inverse texturing challenge. ๐Ÿงต๐Ÿ‘‡

08.08.2025 11:53 โ€” ๐Ÿ‘ 75    ๐Ÿ” 15    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 1
Post image

My lab will be recruiting at all levels. PhD students, postdocs, and a research engineering position (worldwide for PhD/postdoc, EU candidates only for the engineering position). If you're at SIGGRAPH, I'd love to talk to you if you are interested in any of these.

08.08.2025 08:09 โ€” ๐Ÿ‘ 12    ๐Ÿ” 7    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

The reason is that the "volume" of this paper is always rendered as a surface (without alpha blending) during the optimization. Think of it as an end-to-end optimization that accounts for meshing, without actually meshing the object at each step.

08.08.2025 08:01 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

To get a triangle mesh out at the end, you will still need a meshing step (e.g. marching cubes). The key difference is that NeRF requires addtl. optimization & heuristics to create a volume that will ultimately produce a high quality surface. With this new method, it just works.

08.08.2025 08:01 โ€” ๐Ÿ‘ 6    ๐Ÿ” 3    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Wow, this is such a cool paper! Basically with a surprisingly small modification to existing NeRF optimization, this paper gets a really good direct surface reconstruction technique that doesn't require all of the usual mess that meshing a NeRF requires (raymarching, marching cubes, etc).

08.08.2025 07:39 โ€” ๐Ÿ‘ 25    ๐Ÿ” 5    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Check out our paper for more details at rgl.epfl.ch/publications...

07.08.2025 12:21 โ€” ๐Ÿ‘ 9    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

This is a joint work with @ziyizh.bsky.social, @njroussel.bsky.social, Thomas Mรผller, @tizian.bsky.social, @merlin.ninja, and Fabrice Rousselle.

07.08.2025 12:21 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Our method minimizes the expected loss, whereas NeRF optimizes the loss of the expectation.
It generalizes deterministic surface evolution methods (e.g., NvDiffrec) and elegantly handles discontinuities. Future applications include physically based rendering and tomography.

07.08.2025 12:21 โ€” ๐Ÿ‘ 4    ๐Ÿ” 1    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0
Post image

Instead of blending colors along rays and supervising the resulting images, we project the training images into the scene to supervise the radiance field.
Each point along a ray is treated as a surface candidate, independently optimized to match that ray's reference color.

07.08.2025 12:21 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

By changing just a few lines of code, we can adapt existing NeRF frameworks for surface reconstruction.
This patch shows the necessary changes to Instant NGP, which was originally designed for volume reconstruction.

07.08.2025 12:21 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

Methods like NeRF and Gaussian Splats model the world as radioactive fog, rendered using alpha blending. This produces great results.. but are volumes the only way to get there?๐Ÿค” Our new SIGGRAPH'25 paper directly reconstructs surfaces without heuristics or regularizers.

07.08.2025 12:21 โ€” ๐Ÿ‘ 104    ๐Ÿ” 24    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 2
Release notes - Mitsuba 3

It also adds support for function freezing so that the process of rendering a scene can be captured and cheaply replayed. See mitsuba.readthedocs.io/en/latest/re... for details.

07.08.2025 11:15 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Release notes - Mitsuba 3

Mitsuba significantly improves performance on the OptiX backend and adopts SER (Shader Execution Reordering) throughout various integrators. It adds special shapes and an integrator for gaussian splatting, a sun-sky emitter, and fixes missing partial derivative terms in differentiable integrators.

07.08.2025 11:15 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Changelog -

Dr.Jit adds matrix operations that compile to tensor core (CUDA) or vector instruction sets like AVX512, neural network abstractions, grid/permutohedral encodings, function freezing, and shader execution reordering (SER). Many improvements simplify development. drjit.readthedocs.io/en/stable/ch...

07.08.2025 11:15 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Dr.Jit+Mitsuba just added support for fused neural networks, hash grids, and function freezing to eliminate tracing overheads. This significantly accelerates optimization &realtime workloads and enables custom Instant NGP and neural material/radiosity/path guiding projects. What will you do with it?

07.08.2025 11:15 โ€” ๐Ÿ‘ 36    ๐Ÿ” 6    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 2
Video thumbnail

๐Ž๐ฏ๐ž๐ซ๐ฉ๐ซ๐ข๐ง๐ญ๐ข๐ง๐  ๐ฐ๐ข๐ญ๐ก ๐“๐จ๐ฆ๐จ๐ ๐ซ๐š๐ฉ๐ก๐ข๐œ ๐•๐จ๐ฅ๐ฎ๐ฆ๐ž๐ญ๐ซ๐ข๐œ ๐€๐๐๐ข๐ญ๐ข๐ฏ๐ž ๐Œ๐š๐ง๐ฎ๐Ÿ๐š๐œ๐ญ๐ฎ๐ซ๐ข๐ง๐ 

Imagine 3D printing directly onto an object that already exists.

With Tomographic Volumetric Additive Manufacturing (TVAM), we can now print over existing components, opening up a world of possibilities for multi-component devices.

21.07.2025 08:22 โ€” ๐Ÿ‘ 10    ๐Ÿ” 3    ๐Ÿ’ฌ 5    ๐Ÿ“Œ 0

I think everyone just uses Ubuntu ๐Ÿคท. If you want to be on the bleeding edge, the blood might be yours..

17.07.2025 11:29 โ€” ๐Ÿ‘ 13    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@wjakob is following 20 prominent accounts