stream blobs to sqlite #1

New issue

Open

opened 2026-07-28 14:38:52 +00:00 by xfnw · 2 comments

xfnw commented

2026-07-28 14:38:52 +00:00

Owner

currently piss just pulls entire blobs into ram both during uploads ~~and requesting stuff~~, which means we cannot handle large files

sqlite has some blob functions that would allow this, but sqlx does not expose them

currently piss just pulls entire blobs into ram both during uploads ~~and requesting stuff~~, which means we cannot handle large files sqlite has [some blob functions] that would allow this, but sqlx does not expose them [some blob functions]: https://sqlite.org/c3ref/blob_open.html

xfnw added a new dependency

2026-07-28 14:40:33 +00:00

#2 range requests

xfnw added the

enhancement

label

2026-07-28 14:42:14 +00:00

xfnw commented

2026-07-29 02:49:18 +00:00

Author

Owner

upstream sqlx issue: https://github.com/transact-rs/sqlx/issues/1732

xfnw referenced this issue from a commit

2026-08-01 00:47:57 +00:00

stream blob responses

xfnw commented

2026-08-01 00:54:46 +00:00

Author

Owner

was able to implement streaming for responses by doing some substr query shenanigans. i do not think there is anything similar for creating blobs though, so we're still stuck on sqlx exposing sqlite's incremental blob io stuff for uploads :(

xfnw removed a dependency

2026-08-01 02:30:36 +00:00

#2 range requests

xfnw changed title from ~~stream blobs to/from sqlite~~ to stream blobs to sqlite

2026-08-01 02:31:12 +00:00