Consume items in batch, instead of one by one

[mnecochear]

Hi,

I have a situation like the one outlined in the image below, where my producer feeds Products to a function that queries a database for some information about them. I'd like to get this information in batch, and not one by one, so that I don't open & close too many connections to the database. Is there a function that can serve this purpose (Something like awaitMany, for instance)? Or a good way to achieve this?

Thank you!

[snoyberg]

I would recommend working with a stream of Vector a instead of a. The general term we use for this is chunking, and many functions in conduit have chunked equivalents (eg mapC vs mapCE).

…

On Wed, Jul 10, 2019, 1:34 AM mnecochear ***@***.***> wrote: Hi, I have a situation like the one outlined in the image below, where my producer feeds Products to a function that queries a database for some information about them. I'd like to get this information in batch, and not one by one, so that I don't open & close too many connections to the database. Is there a function that can serve this purpose (Something like awaitMany, for instance)? Or a good way to achieve this? [image: outline] <https://user-images.githubusercontent.com/5271682/60927502-290cf100-a278-11e9-87cf-80b56d70a923.png> Thank you! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#418?email_source=notifications&email_token=AAAMCB5HNEJWUQFLMC2UD4LP6UHANA5CNFSM4H7J2762YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4G6G2AOQ>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAAMCBYJ34QYPHWEJRPQTG3P6UHANANCNFSM4H7J276Q> .