Ctrlk
celantur.com
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Benchmarks

Celantur Edge SDK benchmarks

RTX 4090 24 GB, AMD Ryzen 9 7900X

Hardware specification:

  • AMD Ryzen 9 7900X 12-Core Processor

  • G.SKILL Flare X5 64 GB RAM (2x32)

  • MSI MAG B760 TOMAHAWK WIFI DDR5 Mainboard, Intel

  • Asus GeForce RTX 4090 24 GB

  • 2 TB Samsung SSD 980 PRO, PCIe 4.0 NVMe M.2

Images (GPU, TensorRT)

  • Measured with Celantur SDK v1.5.1.

  • Processing time of 100 images using GPU.

  • One SDK process running (higher throuput by parallelization possible).

  • Includes software ramp-up time (end-to-end).

Image Resolution (Tiling)
E2E Throughput (imgs/s)
Processing Time (100 images)
VRAM
RAM

1 MP (1 Tile)

36

2.8 s

682 MB

490 MB

2 MP (1 Tile)

34

3 s

682 MB

490 MB

8 MP (2 Tiles)

11

9.1 s

682 MB

490 MB

72 MP (4 Tiles)

8.8

11.3 s

682 MB

655 MB

Image Resolution (Tiling)
E2E Throughput (imgs/s)
Processing Time (100 images)
VRAM
RAM

1 MP (1 Tile)

121

0.83 s

554 MB

484 MB

2 MP (1 Tile)

101

0.99 s

554 MB

484 MB

8 MP (2 Tiles)

17

5.88 s

554 MB

484 MB

72 MP (4 Tiles)

10

10 s

554 MB

662 MB

Images (CPU Mode)

  • Measured with Celantur Edge SDK v1.5.1.

  • Processing time of 100 images using CPU (OpenVINO).

  • One SDK process running (higher throuput by parallelization possible).

  • Includes software ramp-up time (end-to-end).

Image Resolution (Tiling)
E2E Throughput (imgs/s)
Processing Time (100 images)
CPU Util.
RAM

1 MP (1 Tile)

7

14.29 s

86%

670 MB

2 MP (1 Tile)

7

14.29 s

86%

670 MB

8 MP (2 Tiles)

3

33.33 s

75%

670 MB

72 MP (4 Tiles)

1.65

60.61 s

57%

878 MB

Image Resolution (Tiling)
E2E Throughput (imgs/s)
Processing Time (100 images)
CPU Util.
RAM

1 MP (1 Tile)

27

3.7 s

81%

655 MB

2 MP (1 Tile)

24

4.17 s

68%

655 MB

8 MP (2 Tiles)

8

12.5 s

56%

655 MB

72 MP (4 Tiles)

5

20 s

31%

673 MB

Image Resolution (Tiling)
E2E Throughput (imgs/s)
Processing Time (100 images)
CPU Util.
RAM

1 MP (1 Tile)

1.6

62 s

96%

1,4 GB

2 MP (1 Tile)

1.5

66 s

95%

1,3 GB

8 MP (2 Tiles)

0.75

133 s

92%

1,5 GB

72 MP (4 Tiles)

0.4

250 s

84%

1,7 GB

Nvidia Jetson AGX Orin Developer Kit

Images

Measured with Celantur Edge SDK v1.0.0.

Processing time of 100 images on Nvidia Jetson AGX Orin Developer Kit. Includes software ramp-up time (end-to-end).

Image Resolution / Tiling
Processing Time (100 images)
Memory Utilization

1 MP (1 Tile)

3.3 s

686 MB VRAM, < 500 MB RAM

2 MP (1 Tile)

3.3 s

686 MB VRAM, < 500 MB RAM

8 MP (2 Tiles)

7.6 s

686 MB VRAM, < 500 MB RAM

PreviousArchitecture
NextTroubleshooting

Last updated