Ruby中如何为AWS Elasticsearch POST请求传递Payload并实现数据过滤限制

It looks like you’re on the right track with using AWS Sigv4 to authenticate your Elasticsearch (ES) requests, but there are a couple of tweaks to get filtering and record limits working properly. Here’s how to fix and expand your code:

First, your request body needs to be valid JSON—the current '{size:100}' isn’t valid because JSON requires double quotes around keys and string values. You can also add filtering criteria directly in this body to narrow down your results. I’ll also complete the missing parts of your signature and request logic.

Corrected & Complete Code #

require 'openssl'
require 'aws-sdk-sigv4'
require 'net/http'
require 'json'

# Define your search parameters: record limit + filter criteria
search_body = {
  size: 100, # Set your desired maximum number of records here
  query: {
    # Example filter: match records where "status" is "active"
    match: {
      status: "active"
    }
  }
}.to_json # Convert Ruby hash to valid JSON string

# Calculate SHA256 hash of the request body for Sigv4 signing
payload_hash = OpenSSL::Digest.new("sha256").hexdigest(search_body)

# ES endpoint URL (replace with your actual host/index)
url = URI("https://myhost/index_name/_search")

# Initialize AWS Sigv4 signer
signer = Aws::Sigv4::Signer.new(
  service: 'es',
  region: 'us-west-1',
  access_key_id: 'YOUR_ACCESS_KEY',
  secret_access_key: 'YOUR_SECRET_KEY' # Completed the missing secret key field
)

# Generate signed request headers
headers = signer.sign_request(
  http_method: 'POST',
  url: url.to_s,
  headers: { 'Content-Type' => 'application/json' },
  body: payload_hash
).headers

# Execute the HTTP POST request to ES
http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true
request = Net::HTTP::Post.new(url, headers)
request.body = search_body

response = http.request(request)

# Parse and handle the response
if response.is_a?(Net::HTTPSuccess)
  results = JSON.parse(response.body)
  puts "Fetched #{results['hits']['total']['value']} matching records:"
  results['hits']['hits'].each do |hit|
    puts hit['_source'] # Access the actual record data here
  end
else
  puts "Request failed: #{response.code} #{response.message}"
  puts response.body # Print error details from ES
end

Key Details to Note: #

• Valid JSON: Always convert your Ruby hash to JSON with .to_json—this ensures your request is properly formatted for ES and avoids syntax errors.
• Filtering Flexibility: Adjust the query section to match your needs. For example, use a term query for exact matches, range for date/numeric ranges, or bool for complex AND/OR conditions:

  # Example: Filter records created in January 2024
  query: {
    range: {
      created_at: {
        gte: "2024-01-01",
        lte: "2024-01-31"
      }
    }
  }
  

• Sigv4 Signing: Include the Content-Type: application/json header—ES requires this to correctly parse your request body. Make sure the payload_hash matches the actual body you’re sending.
• Response Handling: ES returns matching records under hits.hits._source—this is where you’ll find the actual data from your indexed documents.

内容的提问来源于stack exchange，提问作者adil hussain