/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/server.py:1723: UserWarning: mlx_lm.server is not recommended for production as it only implements basic security checks.
  warnings.warn(
2026-09-26 19:40:44,490 - INFO - Starting httpd at 127.0.0.1 on port 18804...
127.0.0.1 - - [26/Sep/2026 19:40:45] "GET /v1/models HTTP/1.1" 200 -
2026-09-26 19:40:46,882 - INFO - Prompt Cache: 0 sequences, 0.00 GB
2026-09-26 19:40:46,882 - INFO - - assistant: 0 sequences, 0.00 GB
2026-09-26 19:40:46,882 - INFO - - user: 0 sequences, 0.00 GB
2026-09-26 19:40:46,882 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:40:46] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:40:47,152 - INFO - Prompt processing progress: 20/22
2026-09-26 19:40:47,192 - INFO - Prompt processing progress: 21/22
2026-09-26 19:40:47,223 - INFO - Prompt processing progress: 22/22
2026-09-26 19:40:47,864 - INFO - Prompt Cache: 3 sequences, 0.16 GB
2026-09-26 19:40:47,864 - INFO - - assistant: 2 sequences, 0.10 GB
2026-09-26 19:40:47,864 - INFO - - user: 1 sequences, 0.05 GB
2026-09-26 19:40:47,864 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:40:47] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:40:48,229 - INFO - Prompt processing progress: 40/42
2026-09-26 19:40:48,266 - INFO - Prompt processing progress: 41/42
2026-09-26 19:40:48,291 - INFO - Prompt processing progress: 42/42
2026-09-26 19:41:08,777 - INFO - Prompt Cache: 6 sequences, 0.33 GB
2026-09-26 19:41:08,778 - INFO - - assistant: 4 sequences, 0.23 GB
2026-09-26 19:41:08,778 - INFO - - user: 2 sequences, 0.10 GB
2026-09-26 19:41:08,778 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:41:08] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:41:09,022 - INFO - Prompt processing progress: 1/1
2026-09-26 19:41:29,035 - INFO - Prompt Cache: 6 sequences, 0.33 GB
2026-09-26 19:41:29,036 - INFO - - assistant: 4 sequences, 0.23 GB
2026-09-26 19:41:29,036 - INFO - - user: 2 sequences, 0.10 GB
2026-09-26 19:41:29,036 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:41:29] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:41:29,215 - INFO - Prompt processing progress: 1/1
2026-09-26 19:41:49,203 - INFO - Prompt Cache: 6 sequences, 0.33 GB
2026-09-26 19:41:49,203 - INFO - - assistant: 4 sequences, 0.23 GB
2026-09-26 19:41:49,203 - INFO - - user: 2 sequences, 0.10 GB
2026-09-26 19:41:49,203 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:41:49] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:41:49,456 - INFO - Prompt processing progress: 21/23
2026-09-26 19:41:49,493 - INFO - Prompt processing progress: 22/23
2026-09-26 19:41:49,522 - INFO - Prompt processing progress: 23/23
2026-09-26 19:41:50,167 - INFO - Prompt Cache: 9 sequences, 0.49 GB
2026-09-26 19:41:50,167 - INFO - - assistant: 6 sequences, 0.33 GB
2026-09-26 19:41:50,167 - INFO - - user: 3 sequences, 0.16 GB
2026-09-26 19:41:50,167 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:41:50] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:41:55,894 - INFO - Prompt processing progress: 1995/1997
2026-09-26 19:41:55,942 - INFO - Prompt processing progress: 1996/1997
2026-09-26 19:41:55,972 - INFO - Prompt processing progress: 1997/1997
2026-09-26 19:41:56,694 - INFO - Prompt Cache: 10 sequences, 0.74 GB
2026-09-26 19:41:56,694 - INFO - - assistant: 6 sequences, 0.46 GB
2026-09-26 19:41:56,694 - INFO - - user: 4 sequences, 0.27 GB
2026-09-26 19:41:56,694 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:41:56] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:42:02,351 - INFO - Prompt processing progress: 1977/1979
2026-09-26 19:42:02,393 - INFO - Prompt processing progress: 1978/1979
2026-09-26 19:42:02,422 - INFO - Prompt processing progress: 1979/1979
2026-09-26 19:42:03,075 - INFO - Prompt Cache: 10 sequences, 0.91 GB
2026-09-26 19:42:03,075 - INFO - - assistant: 5 sequences, 0.52 GB
2026-09-26 19:42:03,075 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:42:03,075 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:42:03] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:42:08,805 - INFO - Prompt processing progress: 1988/1990
2026-09-26 19:42:08,851 - INFO - Prompt processing progress: 1989/1990
2026-09-26 19:42:08,880 - INFO - Prompt processing progress: 1990/1990
2026-09-26 19:42:09,554 - INFO - Prompt Cache: 10 sequences, 1.04 GB
2026-09-26 19:42:09,554 - INFO - - assistant: 5 sequences, 0.58 GB
2026-09-26 19:42:09,554 - INFO - - user: 5 sequences, 0.45 GB
2026-09-26 19:42:09,554 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:42:09] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:42:15,313 - INFO - Prompt processing progress: 2048/15469
2026-09-26 19:42:21,019 - INFO - Prompt processing progress: 4096/15469
2026-09-26 19:42:26,840 - INFO - Prompt processing progress: 6144/15469
2026-09-26 19:42:32,774 - INFO - Prompt processing progress: 8192/15469
2026-09-26 19:42:38,847 - INFO - Prompt processing progress: 10240/15469
2026-09-26 19:42:45,065 - INFO - Prompt processing progress: 12288/15469
2026-09-26 19:42:51,363 - INFO - Prompt processing progress: 14336/15469
2026-09-26 19:42:54,926 - INFO - Prompt processing progress: 15467/15469
2026-09-26 19:42:55,027 - INFO - Prompt processing progress: 15468/15469
2026-09-26 19:42:55,072 - INFO - Prompt processing progress: 15469/15469
2026-09-26 19:42:55,795 - INFO - Prompt Cache: 10 sequences, 2.43 GB
2026-09-26 19:42:55,795 - INFO - - assistant: 5 sequences, 1.47 GB
2026-09-26 19:42:55,795 - INFO - - user: 5 sequences, 0.96 GB
2026-09-26 19:42:55,795 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:42:55] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:43:01,602 - INFO - Prompt processing progress: 2048/15489
2026-09-26 19:43:07,318 - INFO - Prompt processing progress: 4096/15489
2026-09-26 19:43:13,143 - INFO - Prompt processing progress: 6144/15489
2026-09-26 19:43:19,085 - INFO - Prompt processing progress: 8192/15489
2026-09-26 19:43:25,149 - INFO - Prompt processing progress: 10240/15489
2026-09-26 19:43:31,322 - INFO - Prompt processing progress: 12288/15489
2026-09-26 19:43:37,607 - INFO - Prompt processing progress: 14336/15489
2026-09-26 19:43:41,179 - INFO - Prompt processing progress: 15487/15489
2026-09-26 19:43:41,249 - INFO - Prompt processing progress: 15488/15489
2026-09-26 19:43:41,296 - INFO - Prompt processing progress: 15489/15489
2026-09-26 19:43:42,032 - INFO - Prompt Cache: 10 sequences, 3.82 GB
2026-09-26 19:43:42,032 - INFO - - assistant: 5 sequences, 2.35 GB
2026-09-26 19:43:42,032 - INFO - - user: 5 sequences, 1.47 GB
2026-09-26 19:43:42,032 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:43:42] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:43:48,004 - INFO - Prompt processing progress: 2048/15497
2026-09-26 19:43:53,733 - INFO - Prompt processing progress: 4096/15497
2026-09-26 19:43:59,560 - INFO - Prompt processing progress: 6144/15497
2026-09-26 19:44:05,504 - INFO - Prompt processing progress: 8192/15497
2026-09-26 19:44:11,572 - INFO - Prompt processing progress: 10240/15497
2026-09-26 19:44:17,765 - INFO - Prompt processing progress: 12288/15497
2026-09-26 19:44:24,071 - INFO - Prompt processing progress: 14336/15497
2026-09-26 19:44:27,753 - INFO - Prompt processing progress: 15495/15497
2026-09-26 19:44:28,710 - INFO - Prompt processing progress: 15496/15497
2026-09-26 19:44:28,794 - INFO - Prompt processing progress: 15497/15497
2026-09-26 19:44:30,063 - INFO - Prompt Cache: 10 sequences, 4.71 GB
2026-09-26 19:44:30,063 - INFO - - assistant: 5 sequences, 2.80 GB
2026-09-26 19:44:30,063 - INFO - - user: 5 sequences, 1.91 GB
2026-09-26 19:44:30,063 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:30] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:30,587 - INFO - Prompt processing progress: 19/21
2026-09-26 19:44:30,624 - INFO - Prompt processing progress: 20/21
2026-09-26 19:44:30,652 - INFO - Prompt processing progress: 21/21
2026-09-26 19:44:31,303 - INFO - Prompt Cache: 10 sequences, 3.63 GB
2026-09-26 19:44:31,303 - INFO - - assistant: 5 sequences, 1.78 GB
2026-09-26 19:44:31,303 - INFO - - user: 5 sequences, 1.85 GB
2026-09-26 19:44:31,303 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:31] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:31,456 - INFO - Prompt Cache: 10 sequences, 3.63 GB
2026-09-26 19:44:31,456 - INFO - - assistant: 5 sequences, 1.78 GB
2026-09-26 19:44:31,456 - INFO - - user: 5 sequences, 1.85 GB
2026-09-26 19:44:31,456 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:31] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:31,608 - INFO - Prompt Cache: 10 sequences, 3.63 GB
2026-09-26 19:44:31,608 - INFO - - assistant: 5 sequences, 1.78 GB
2026-09-26 19:44:31,608 - INFO - - user: 5 sequences, 1.85 GB
2026-09-26 19:44:31,608 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:31] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:31,757 - INFO - Prompt Cache: 10 sequences, 3.63 GB
2026-09-26 19:44:31,757 - INFO - - assistant: 5 sequences, 1.78 GB
2026-09-26 19:44:31,757 - INFO - - user: 5 sequences, 1.85 GB
2026-09-26 19:44:31,757 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:31] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:32,310 - INFO - Prompt processing progress: 26/28
2026-09-26 19:44:32,311 - INFO - Prompt processing progress: 26/28
2026-09-26 19:44:32,311 - INFO - Prompt processing progress: 24/26
2026-09-26 19:44:32,311 - INFO - Prompt processing progress: 25/27
2026-09-26 19:44:32,366 - INFO - Prompt processing progress: 27/28
2026-09-26 19:44:32,366 - INFO - Prompt processing progress: 27/28
2026-09-26 19:44:32,366 - INFO - Prompt processing progress: 26/27
2026-09-26 19:44:32,366 - INFO - Prompt processing progress: 25/26
2026-09-26 19:44:32,411 - INFO - Prompt processing progress: 28/28
2026-09-26 19:44:32,411 - INFO - Prompt processing progress: 28/28
2026-09-26 19:44:32,411 - INFO - Prompt processing progress: 26/26
2026-09-26 19:44:32,411 - INFO - Prompt processing progress: 27/27
2026-09-26 19:44:44,073 - INFO - Prompt Cache: 10 sequences, 0.56 GB
2026-09-26 19:44:44,073 - INFO - - assistant: 5 sequences, 0.30 GB
2026-09-26 19:44:44,073 - INFO - - user: 5 sequences, 0.26 GB
2026-09-26 19:44:44,073 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:44] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:44,231 - INFO - Prompt Cache: 10 sequences, 0.56 GB
2026-09-26 19:44:44,231 - INFO - - assistant: 5 sequences, 0.30 GB
2026-09-26 19:44:44,231 - INFO - - user: 5 sequences, 0.26 GB
2026-09-26 19:44:44,231 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:44] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:44,394 - INFO - Prompt Cache: 10 sequences, 0.56 GB
2026-09-26 19:44:44,394 - INFO - - assistant: 5 sequences, 0.30 GB
2026-09-26 19:44:44,394 - INFO - - user: 5 sequences, 0.26 GB
2026-09-26 19:44:44,394 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:44] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:44,543 - INFO - Prompt Cache: 10 sequences, 0.56 GB
2026-09-26 19:44:44,544 - INFO - - assistant: 5 sequences, 0.30 GB
2026-09-26 19:44:44,544 - INFO - - user: 5 sequences, 0.26 GB
2026-09-26 19:44:44,544 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:44] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:44,789 - INFO - Prompt processing progress: 1/1
2026-09-26 19:44:44,789 - INFO - Prompt processing progress: 1/2
2026-09-26 19:44:44,789 - INFO - Prompt processing progress: 1/2
2026-09-26 19:44:44,789 - INFO - Prompt processing progress: 1/2
2026-09-26 19:44:44,859 - INFO - Prompt processing progress: 2/2
2026-09-26 19:44:44,859 - INFO - Prompt processing progress: 2/2
2026-09-26 19:44:44,859 - INFO - Prompt processing progress: 2/2
2026-09-26 19:44:56,704 - INFO - Prompt Cache: 10 sequences, 0.56 GB
2026-09-26 19:44:56,704 - INFO - - assistant: 5 sequences, 0.30 GB
2026-09-26 19:44:56,704 - INFO - - user: 5 sequences, 0.26 GB
2026-09-26 19:44:56,704 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:56] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:56,960 - INFO - Prompt processing progress: 20/22
2026-09-26 19:44:56,996 - INFO - Prompt processing progress: 21/22
2026-09-26 19:44:57,023 - INFO - Prompt processing progress: 22/22
2026-09-26 19:44:57,666 - INFO - Prompt Cache: 10 sequences, 0.55 GB
2026-09-26 19:44:57,666 - INFO - - assistant: 5 sequences, 0.29 GB
2026-09-26 19:44:57,666 - INFO - - user: 5 sequences, 0.26 GB
2026-09-26 19:44:57,666 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:44:57] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:44:59,999 - INFO - Prompt processing progress: 798/800
2026-09-26 19:45:00,043 - INFO - Prompt processing progress: 799/800
2026-09-26 19:45:00,071 - INFO - Prompt processing progress: 800/800
2026-09-26 19:45:03,390 - INFO - Prompt Cache: 10 sequences, 0.61 GB
2026-09-26 19:45:03,390 - INFO - - assistant: 5 sequences, 0.32 GB
2026-09-26 19:45:03,390 - INFO - - user: 5 sequences, 0.29 GB
2026-09-26 19:45:03,390 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:03] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:05,734 - INFO - Prompt processing progress: 799/801
2026-09-26 19:45:05,773 - INFO - Prompt processing progress: 800/801
2026-09-26 19:45:05,800 - INFO - Prompt processing progress: 801/801
2026-09-26 19:45:09,360 - INFO - Prompt Cache: 10 sequences, 0.68 GB
2026-09-26 19:45:09,360 - INFO - - assistant: 5 sequences, 0.37 GB
2026-09-26 19:45:09,360 - INFO - - user: 5 sequences, 0.31 GB
2026-09-26 19:45:09,360 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:09] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:11,784 - INFO - Prompt processing progress: 802/804
2026-09-26 19:45:11,822 - INFO - Prompt processing progress: 803/804
2026-09-26 19:45:11,848 - INFO - Prompt processing progress: 804/804
2026-09-26 19:45:17,416 - INFO - Prompt Cache: 10 sequences, 0.74 GB
2026-09-26 19:45:17,416 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:17,416 - INFO - - user: 5 sequences, 0.34 GB
2026-09-26 19:45:17,416 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:17] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:19,766 - INFO - Prompt processing progress: 797/799
2026-09-26 19:45:19,804 - INFO - Prompt processing progress: 798/799
2026-09-26 19:45:19,830 - INFO - Prompt processing progress: 799/799
2026-09-26 19:45:23,623 - INFO - Prompt Cache: 10 sequences, 0.76 GB
2026-09-26 19:45:23,623 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:23,623 - INFO - - user: 5 sequences, 0.36 GB
2026-09-26 19:45:23,623 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:23] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:26,013 - INFO - Prompt processing progress: 797/799
2026-09-26 19:45:26,051 - INFO - Prompt processing progress: 798/799
2026-09-26 19:45:26,076 - INFO - Prompt processing progress: 799/799
2026-09-26 19:45:31,317 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:45:31,317 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:31,317 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:45:31,317 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:31] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:33,752 - INFO - Prompt processing progress: 807/809
2026-09-26 19:45:33,790 - INFO - Prompt processing progress: 808/809
2026-09-26 19:45:33,816 - INFO - Prompt processing progress: 809/809
2026-09-26 19:45:36,972 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:45:36,973 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:36,973 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:45:36,973 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:36] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:39,425 - INFO - Prompt processing progress: 806/808
2026-09-26 19:45:39,462 - INFO - Prompt processing progress: 807/808
2026-09-26 19:45:39,487 - INFO - Prompt processing progress: 808/808
2026-09-26 19:45:42,873 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:45:42,873 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:42,873 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:45:42,873 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:42] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:45,298 - INFO - Prompt processing progress: 804/806
2026-09-26 19:45:45,335 - INFO - Prompt processing progress: 805/806
2026-09-26 19:45:45,361 - INFO - Prompt processing progress: 806/806
2026-09-26 19:45:50,649 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:45:50,649 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:50,649 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:45:50,649 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:50] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:45:53,054 - INFO - Prompt processing progress: 803/805
2026-09-26 19:45:53,091 - INFO - Prompt processing progress: 804/805
2026-09-26 19:45:53,116 - INFO - Prompt processing progress: 805/805
2026-09-26 19:45:59,354 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:45:59,354 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:45:59,354 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:45:59,354 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:45:59] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:01,720 - INFO - Prompt processing progress: 800/802
2026-09-26 19:46:01,757 - INFO - Prompt processing progress: 801/802
2026-09-26 19:46:01,786 - INFO - Prompt processing progress: 802/802
2026-09-26 19:46:05,531 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:46:05,531 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:46:05,531 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:05,531 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:05] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:07,916 - INFO - Prompt processing progress: 799/801
2026-09-26 19:46:07,952 - INFO - Prompt processing progress: 800/801
2026-09-26 19:46:07,978 - INFO - Prompt processing progress: 801/801
2026-09-26 19:46:11,337 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:46:11,337 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:46:11,337 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:11,337 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:11] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:13,739 - INFO - Prompt processing progress: 802/804
2026-09-26 19:46:13,777 - INFO - Prompt processing progress: 803/804
2026-09-26 19:46:13,802 - INFO - Prompt processing progress: 804/804
2026-09-26 19:46:17,468 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:46:17,468 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:46:17,468 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:17,468 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:17] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:19,884 - INFO - Prompt processing progress: 804/806
2026-09-26 19:46:19,922 - INFO - Prompt processing progress: 805/806
2026-09-26 19:46:19,948 - INFO - Prompt processing progress: 806/806
2026-09-26 19:46:23,461 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:46:23,461 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:46:23,461 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:23,461 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:23] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:25,868 - INFO - Prompt processing progress: 810/812
2026-09-26 19:46:25,905 - INFO - Prompt processing progress: 811/812
2026-09-26 19:46:25,931 - INFO - Prompt processing progress: 812/812
2026-09-26 19:46:32,289 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:46:32,290 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:46:32,290 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:32,290 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:32] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:34,770 - INFO - Prompt processing progress: 809/811
2026-09-26 19:46:34,808 - INFO - Prompt processing progress: 810/811
2026-09-26 19:46:34,836 - INFO - Prompt processing progress: 811/811
2026-09-26 19:46:42,204 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:46:42,204 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:46:42,204 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:42,204 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:42] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:44,655 - INFO - Prompt processing progress: 815/817
2026-09-26 19:46:44,692 - INFO - Prompt processing progress: 816/817
2026-09-26 19:46:44,717 - INFO - Prompt processing progress: 817/817
2026-09-26 19:46:50,518 - INFO - Prompt Cache: 10 sequences, 0.80 GB
2026-09-26 19:46:50,518 - INFO - - assistant: 5 sequences, 0.41 GB
2026-09-26 19:46:50,518 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:46:50,518 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:46:50] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:46:52,933 - INFO - Prompt processing progress: 818/820
2026-09-26 19:46:52,972 - INFO - Prompt processing progress: 819/820
2026-09-26 19:46:53,001 - INFO - Prompt processing progress: 820/820
2026-09-26 19:47:01,864 - INFO - Prompt Cache: 10 sequences, 0.80 GB
2026-09-26 19:47:01,864 - INFO - - assistant: 5 sequences, 0.41 GB
2026-09-26 19:47:01,865 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:01,865 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:01] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:04,342 - INFO - Prompt processing progress: 817/819
2026-09-26 19:47:04,379 - INFO - Prompt processing progress: 818/819
2026-09-26 19:47:04,405 - INFO - Prompt processing progress: 819/819
2026-09-26 19:47:13,190 - INFO - Prompt Cache: 10 sequences, 0.80 GB
2026-09-26 19:47:13,190 - INFO - - assistant: 5 sequences, 0.41 GB
2026-09-26 19:47:13,190 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:13,190 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:13] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:15,613 - INFO - Prompt processing progress: 808/810
2026-09-26 19:47:15,650 - INFO - Prompt processing progress: 809/810
2026-09-26 19:47:15,676 - INFO - Prompt processing progress: 810/810
2026-09-26 19:47:22,733 - INFO - Prompt Cache: 10 sequences, 0.80 GB
2026-09-26 19:47:22,734 - INFO - - assistant: 5 sequences, 0.41 GB
2026-09-26 19:47:22,734 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:22,734 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:22] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:25,134 - INFO - Prompt processing progress: 797/799
2026-09-26 19:47:25,171 - INFO - Prompt processing progress: 798/799
2026-09-26 19:47:25,197 - INFO - Prompt processing progress: 799/799
2026-09-26 19:47:28,363 - INFO - Prompt Cache: 10 sequences, 0.80 GB
2026-09-26 19:47:28,363 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:47:28,363 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:28,363 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:28] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:30,701 - INFO - Prompt processing progress: 800/802
2026-09-26 19:47:30,739 - INFO - Prompt processing progress: 801/802
2026-09-26 19:47:30,765 - INFO - Prompt processing progress: 802/802
2026-09-26 19:47:33,652 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:47:33,652 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:47:33,652 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:33,652 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:33] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:35,991 - INFO - Prompt processing progress: 799/801
2026-09-26 19:47:36,029 - INFO - Prompt processing progress: 800/801
2026-09-26 19:47:36,054 - INFO - Prompt processing progress: 801/801
2026-09-26 19:47:38,833 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:47:38,833 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:47:38,833 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:38,833 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:38] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:41,162 - INFO - Prompt processing progress: 800/802
2026-09-26 19:47:41,199 - INFO - Prompt processing progress: 801/802
2026-09-26 19:47:41,226 - INFO - Prompt processing progress: 802/802
2026-09-26 19:47:44,554 - INFO - Prompt Cache: 10 sequences, 0.78 GB
2026-09-26 19:47:44,554 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:47:44,554 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:44,554 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:44] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:46,910 - INFO - Prompt processing progress: 797/799
2026-09-26 19:47:46,949 - INFO - Prompt processing progress: 798/799
2026-09-26 19:47:46,976 - INFO - Prompt processing progress: 799/799
2026-09-26 19:47:49,889 - INFO - Prompt Cache: 10 sequences, 0.78 GB
2026-09-26 19:47:49,889 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:47:49,889 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:49,889 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:49] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:52,280 - INFO - Prompt processing progress: 799/801
2026-09-26 19:47:52,318 - INFO - Prompt processing progress: 800/801
2026-09-26 19:47:52,343 - INFO - Prompt processing progress: 801/801
2026-09-26 19:47:54,979 - INFO - Prompt Cache: 10 sequences, 0.78 GB
2026-09-26 19:47:54,979 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:47:54,979 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:47:54,979 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:47:54] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:47:57,416 - INFO - Prompt processing progress: 804/806
2026-09-26 19:47:57,453 - INFO - Prompt processing progress: 805/806
2026-09-26 19:47:57,479 - INFO - Prompt processing progress: 806/806
2026-09-26 19:48:00,704 - INFO - Prompt Cache: 10 sequences, 0.78 GB
2026-09-26 19:48:00,704 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:48:00,704 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:48:00,704 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:48:00] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:48:03,030 - INFO - Prompt processing progress: 799/801
2026-09-26 19:48:03,069 - INFO - Prompt processing progress: 800/801
2026-09-26 19:48:03,095 - INFO - Prompt processing progress: 801/801
2026-09-26 19:48:09,292 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:48:09,292 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:48:09,292 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:48:09,292 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:48:09] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:48:11,736 - INFO - Prompt processing progress: 802/804
2026-09-26 19:48:11,774 - INFO - Prompt processing progress: 803/804
2026-09-26 19:48:11,799 - INFO - Prompt processing progress: 804/804
2026-09-26 19:48:17,964 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:48:17,964 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:48:17,964 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:48:17,964 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:48:17] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:48:20,327 - INFO - Prompt processing progress: 799/801
2026-09-26 19:48:20,365 - INFO - Prompt processing progress: 800/801
2026-09-26 19:48:20,391 - INFO - Prompt processing progress: 801/801
2026-09-26 19:48:25,852 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:48:25,852 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:48:25,852 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:48:25,852 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:48:25] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:48:28,188 - INFO - Prompt processing progress: 800/802
2026-09-26 19:48:28,225 - INFO - Prompt processing progress: 801/802
2026-09-26 19:48:28,250 - INFO - Prompt processing progress: 802/802
2026-09-26 19:48:34,123 - INFO - Prompt Cache: 10 sequences, 0.79 GB
2026-09-26 19:48:34,123 - INFO - - assistant: 5 sequences, 0.40 GB
2026-09-26 19:48:34,123 - INFO - - user: 5 sequences, 0.39 GB
2026-09-26 19:48:34,123 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:48:34] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:48:34,381 - INFO - Prompt processing progress: 20/22
2026-09-26 19:48:34,417 - INFO - Prompt processing progress: 21/22
2026-09-26 19:48:34,442 - INFO - Prompt processing progress: 22/22
2026-09-26 19:48:35,146 - INFO - Prompt Cache: 10 sequences, 0.71 GB
2026-09-26 19:48:35,146 - INFO - - assistant: 5 sequences, 0.35 GB
2026-09-26 19:48:35,146 - INFO - - user: 5 sequences, 0.36 GB
2026-09-26 19:48:35,146 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:48:35] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:48:40,979 - INFO - Prompt processing progress: 2048/22675
2026-09-26 19:48:46,967 - INFO - Prompt processing progress: 4096/22675
2026-09-26 19:48:53,146 - INFO - Prompt processing progress: 6144/22675
2026-09-26 19:48:59,387 - INFO - Prompt processing progress: 8192/22675
2026-09-26 19:49:05,672 - INFO - Prompt processing progress: 10240/22675
2026-09-26 19:49:12,002 - INFO - Prompt processing progress: 12288/22675
2026-09-26 19:49:18,470 - INFO - Prompt processing progress: 14336/22675
2026-09-26 19:49:25,139 - INFO - Prompt processing progress: 16384/22675
2026-09-26 19:49:31,910 - INFO - Prompt processing progress: 18432/22675
2026-09-26 19:49:38,751 - INFO - Prompt processing progress: 20480/22675
2026-09-26 19:49:45,525 - INFO - Prompt processing progress: 22528/22675
2026-09-26 19:49:46,086 - INFO - Prompt processing progress: 22660/22675
2026-09-26 19:49:46,271 - INFO - Prompt processing progress: 22673/22675
2026-09-26 19:49:46,331 - INFO - Prompt processing progress: 22674/22675
2026-09-26 19:49:46,390 - INFO - Prompt processing progress: 22675/22675
2026-09-26 19:49:47,330 - INFO - Prompt Cache: 10 sequences, 3.57 GB
2026-09-26 19:49:47,330 - INFO - - assistant: 4 sequences, 1.69 GB
2026-09-26 19:49:47,330 - INFO - - user: 5 sequences, 1.08 GB
2026-09-26 19:49:47,330 - INFO - - system: 1 sequences, 0.79 GB
127.0.0.1 - - [26/Sep/2026 19:49:47] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:49:47,820 - INFO - Prompt processing progress: 40/42
2026-09-26 19:49:47,885 - INFO - Prompt processing progress: 41/42
2026-09-26 19:49:47,998 - INFO - Prompt processing progress: 42/42
2026-09-26 19:49:48,850 - INFO - Prompt Cache: 10 sequences, 5.77 GB
2026-09-26 19:49:48,851 - INFO - - assistant: 4 sequences, 3.18 GB
2026-09-26 19:49:48,851 - INFO - - user: 5 sequences, 1.80 GB
2026-09-26 19:49:48,851 - INFO - - system: 1 sequences, 0.79 GB
127.0.0.1 - - [26/Sep/2026 19:49:48] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:49:49,313 - INFO - Prompt processing progress: 37/39
2026-09-26 19:49:49,383 - INFO - Prompt processing progress: 38/39
2026-09-26 19:49:49,448 - INFO - Prompt processing progress: 39/39
2026-09-26 19:49:50,334 - INFO - Prompt Cache: 10 sequences, 6.50 GB
2026-09-26 19:49:50,334 - INFO - - assistant: 4 sequences, 3.19 GB
2026-09-26 19:49:50,334 - INFO - - user: 5 sequences, 2.52 GB
2026-09-26 19:49:50,334 - INFO - - system: 1 sequences, 0.79 GB
127.0.0.1 - - [26/Sep/2026 19:49:50] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:49:50,852 - INFO - Prompt processing progress: 40/42
Exception in thread Thread-1 (_generate):
Traceback (most recent call last):
  File "/opt/homebrew/Cellar/python@3.11/3.11.15_4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
    self.run()
  File "/opt/homebrew/Cellar/python@3.11/3.11.15_4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/threading.py", line 982, in run
    self._target(*self._args, **self._kwargs)
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/server.py", line 853, in _generate
    prompt_responses, gen_responses = batch_generator.next()
                                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1855, in next
    return self._next()
           ^^^^^^^^^^^^
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1841, in _next
    self._prompt_batch.prompt(prompts)
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1161, in prompt
    mx.eval([c.state for c in self.prompt_cache])
RuntimeError: [METAL] Command buffer execution failed: Insufficient Memory (00000008:kIOGPUCommandBufferCallbackErrorOutOfMemory).
/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/server.py:1723: UserWarning: mlx_lm.server is not recommended for production as it only implements basic security checks.
  warnings.warn(
2026-09-26 19:54:53,388 - INFO - Starting httpd at 127.0.0.1 on port 18804...
127.0.0.1 - - [26/Sep/2026 19:54:54] "GET /v1/models HTTP/1.1" 200 -
2026-09-26 19:54:55,574 - INFO - Prompt Cache: 0 sequences, 0.00 GB
2026-09-26 19:54:55,574 - INFO - - assistant: 0 sequences, 0.00 GB
2026-09-26 19:54:55,574 - INFO - - user: 0 sequences, 0.00 GB
2026-09-26 19:54:55,574 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:54:55] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:54:55,833 - INFO - Prompt processing progress: 20/22
2026-09-26 19:54:55,872 - INFO - Prompt processing progress: 21/22
2026-09-26 19:54:55,903 - INFO - Prompt processing progress: 22/22
2026-09-26 19:54:56,616 - INFO - Prompt Cache: 3 sequences, 0.16 GB
2026-09-26 19:54:56,616 - INFO - - assistant: 2 sequences, 0.10 GB
2026-09-26 19:54:56,616 - INFO - - user: 1 sequences, 0.05 GB
2026-09-26 19:54:56,616 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [26/Sep/2026 19:54:56] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:55:02,382 - INFO - Prompt processing progress: 2048/22675
2026-09-26 19:55:08,087 - INFO - Prompt processing progress: 4096/22675
2026-09-26 19:55:13,901 - INFO - Prompt processing progress: 6144/22675
2026-09-26 19:55:19,827 - INFO - Prompt processing progress: 8192/22675
2026-09-26 19:55:25,867 - INFO - Prompt processing progress: 10240/22675
2026-09-26 19:55:32,018 - INFO - Prompt processing progress: 12288/22675
2026-09-26 19:55:38,283 - INFO - Prompt processing progress: 14336/22675
2026-09-26 19:55:44,653 - INFO - Prompt processing progress: 16384/22675
2026-09-26 19:55:51,133 - INFO - Prompt processing progress: 18432/22675
2026-09-26 19:55:57,728 - INFO - Prompt processing progress: 20480/22675
2026-09-26 19:56:04,451 - INFO - Prompt processing progress: 22528/22675
2026-09-26 19:56:05,010 - INFO - Prompt processing progress: 22660/22675
2026-09-26 19:56:05,213 - INFO - Prompt processing progress: 22673/22675
2026-09-26 19:56:05,272 - INFO - Prompt processing progress: 22674/22675
2026-09-26 19:56:05,330 - INFO - Prompt processing progress: 22675/22675
2026-09-26 19:56:06,292 - INFO - Prompt Cache: 7 sequences, 3.34 GB
2026-09-26 19:56:06,293 - INFO - - assistant: 4 sequences, 1.69 GB
2026-09-26 19:56:06,293 - INFO - - user: 2 sequences, 0.85 GB
2026-09-26 19:56:06,293 - INFO - - system: 1 sequences, 0.79 GB
127.0.0.1 - - [26/Sep/2026 19:56:06] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:56:06,755 - INFO - Prompt processing progress: 40/42
2026-09-26 19:56:06,814 - INFO - Prompt processing progress: 41/42
2026-09-26 19:56:06,956 - INFO - Prompt processing progress: 42/42
2026-09-26 19:56:07,772 - INFO - Prompt Cache: 10 sequences, 5.72 GB
2026-09-26 19:56:07,772 - INFO - - assistant: 6 sequences, 3.29 GB
2026-09-26 19:56:07,772 - INFO - - user: 3 sequences, 1.64 GB
2026-09-26 19:56:07,772 - INFO - - system: 1 sequences, 0.79 GB
127.0.0.1 - - [26/Sep/2026 19:56:07] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-09-26 19:56:08,235 - INFO - Prompt processing progress: 37/39
2026-09-26 19:56:08,303 - INFO - Prompt processing progress: 38/39
Exception in thread Thread-1 (_generate):
Traceback (most recent call last):
  File "/opt/homebrew/Cellar/python@3.11/3.11.15_4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
    self.run()
  File "/opt/homebrew/Cellar/python@3.11/3.11.15_4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/threading.py", line 982, in run
    self._target(*self._args, **self._kwargs)
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/server.py", line 853, in _generate
    prompt_responses, gen_responses = batch_generator.next()
                                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1855, in next
    return self._next()
           ^^^^^^^^^^^^
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1809, in _next
    gen_batch = self._prompt_batch.split(split).generate(last_inputs)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1186, in generate
    generation = GenerationBatch(
                 ^^^^^^^^^^^^^^^^
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1288, in __init__
    self._step()
  File "/private/tmp/geo-compare-laptop/rmlx-venv/lib/python3.11/site-packages/mlx_lm/generate.py", line 1369, in _step
    mx.async_eval(self._next_tokens, self._next_logprobs, token_context)
RuntimeError: [METAL] Command buffer execution failed: Insufficient Memory (00000008:kIOGPUCommandBufferCallbackErrorOutOfMemory).