• Nick Thomas's avatar
    Reduce the number of Elasticsearch client instances that are created · d87f2518
    Nick Thomas authored
    When collecting instance profile credentials in AWS, each client instantiation
    is a HTTP request to an external web service. This service may rate-limit us
    if we perform too many requests in a given time period.
    
    A typical GitLab deployment will have many processes running, and each of those
    processes needs *one* elasticsearch client instance. The client instance is
    thread-safe and handles concurrent requests very well, with HTTP keep-alive
    connections.
    
    Prior to this commit, each process using elasticsearch would instantiate one
    client per *class* that used `Elasticsearch::Model::Client`. So a multi-node
    setup might look like:
    
    ```
    * Server A
      * Unicorn parent
        * Unicorn child A
          * Client for Project class
          * Client for Repository class
          * Client for Issue class
          * ...
        * Unicorn child B
          * Client for Project class
          * Client for Repository class
          * Client for Issue class
          * ...
      * Sidekiq
        * Client for Project class
        * Client for Repository class
        * Client for Issue class
        * ...
    * Server B
      * Unicorn master
        * ... (same as above)
      * Sidekiq
        * .... (same as above)
    ```
    
    (total: N, plus N per unicorn child, multipled by the number of servers)
    
    Following this commit, we have the following clients instead:
    
    ```
    * Server A
      * Sidekiq (1 client)
      * Unicorn parent
        * Unicorn child A (1 client)
        * Unicorn child b (1 client)
    * Server B
      * ... (same as above)
    ```
    
    (total: 1, + 1 per unicorn child, multipled by the number of servers)
    
    This drastically reduces the number of HTTP connections we make to the
    Elasticsearch and AWS instance profile credentials servers, and should
    come with a small increase in performance due to better utilisation of
    those connections.
    d87f2518
elastic_client_setup.rb 1.38 KB