is there any way to resume streams?

[pchen41]

I'm using useChat which works well for streaming responses, but I'd like some way to resume the stream if the user reloads the page (or at the very least if the component unmounts). Is there any recommended way to do this? I was looking into potentially creating a service worker to receive the stream data, but it doesn't seem like the best approach as I'd have to reimplement a bunch of stuff already built into useChat.

[grmkris]

Same here

Maybe storing each completed step into db and if user breaks off you send abort signal and you resume from last saved step

[pchen41]

I ended up using consumeStream() to guarantee that the message completes and storing each step into the db. I have my client set up to receive updates via supabase realtime (with some merging logic to ignore the realtime updates if the stream is still connected).

[grmkris]

but this way you don't get nice streaming right? you get just whole message as it is being stored in the supabase?

[pchen41]

yeah it's not great, but it'll have to do for now. in the future I'll probably look into creating a temporary supabase realtime channel when the response starts streaming from the server and having the client check of a live channel whenever it loads the chat.

[akshaylingamaneni]

doesn't sound scalable, if you have couple of 100 users, storing for each update, will be a bottleneck aint it?

[cramforce]

Support is now available here https://ai-sdk.dev/docs/ai-sdk-ui/chatbot-message-persistence#resuming-ongoing-streams

See also https://x.com/rauchg/status/1921168985900372081

[hoqua]

If you need to resume streams you can use something like : https://www.durablr.run/docs - check resumable

[github-actions[bot]]

This discussion was automatically locked because it has not been updated in over 30 days. If you still have questions about this topic, please ask us at community.vercel.com/ai-sdk