如何为Jest批量插入设置批次大小？

Absolutely! You can easily control the batch size for bulk insertions using Jest by manually managing the number of actions added to a BulkRequest before executing it. Here's how to adjust your existing code to insert 1000 documents per batch:

Step-by-Step Implementation #

First, we'll add a counter to track the number of documents in the current batch, and execute the bulk request once we hit your target of 1000. We'll also handle any remaining documents that don't fill a full batch at the end.

// Initialize bulk request and tracking variables
BulkRequest bulkRequest = new BulkRequest.Builder().build();
final int TARGET_BATCH_SIZE = 1000;
int currentBatchCount = 0;

// Assume you have a collection of models to insert (adjust this to your actual data source)
for (PubAdStatsGeoWiseModel model : yourModelCollection) {
    // Add the index action to the bulk request (fixed the extra dot in your original code!)
    bulkRequest.addAction(
        new Index.Builder(model)
            .index(PublisherStatsConstants.geo_wise_ad_users_by_day_index)
            .type(PublisherStatsConstants.geo_wise_ad_users_by_day_type)
            .id(upsertUniqueId(res))
            .build()
    );
    currentBatchCount++;

    // Execute the batch when we reach the target size
    if (currentBatchCount == TARGET_BATCH_SIZE) {
        jestClient.execute(bulkRequest.build());
        // Reset for the next batch
        bulkRequest = new BulkRequest.Builder().build();
        currentBatchCount = 0;
    }
}

// Don't forget to insert any remaining documents that didn't fill a full batch
if (currentBatchCount > 0) {
    jestClient.execute(bulkRequest.build());
}

Key Notes: #

• Fix for Your Original Code: Notice I removed the extra dot after .type() in your original snippet — that would have caused a compile error!
• Manual Batch Management: Jest doesn't have an auto-batching feature built-in, so this manual approach is the standard way to control batch sizes.
• Robustness Tip: For production code, add error handling around the jestClient.execute() call to catch and handle exceptions (like network issues or Elasticsearch errors). For example:

  if (currentBatchCount == TARGET_BATCH_SIZE) {
      try {
          jestClient.execute(bulkRequest.build());
      } catch (IOException e) {
          // Log the error, retry the batch, or handle it according to your needs
          System.err.println("Failed to execute batch: " + e.getMessage());
      }
      bulkRequest = new BulkRequest.Builder().build();
      currentBatchCount = 0;
  }
  

内容的提问来源于stack exchange，提问作者vinayak futak