Import from bucket when using integrated inference

Feature Requests
1

Hi all.

Does the import from s3 work with this? If not, will there be an option for this in the future?

My current understand is that it does not due to the import files needing the embedding data within it.

Thanks and I appreciate everyones time.

2

Thanks for asking! We are actively looking into support this functionality. How many records would you be bringing in a typical import job and how often would it be running.

3

Hello and thanks for the quick reply.

Looking at importing hundreds of millions of records initially and currently do not have an estimate on how often. But if it was able to ingest into existing namespaces, it would be deltas every hour or so.