worker thread pool of 1, gremlin pool of 1 and boss thread pool of 1 ?
Hello - I have an remote gremlin setup backend as cassandra, In my gremlin remote logs I see a log statement "INFO org.apache.tinkerpop.gremlin.server.GremlinServer - Gremlin Server configured with worker thread pool of 1, gremlin pool of 1 and boss thread pool of 1." Can some help me understand what does it meant by worker thread pool of 1, gremlin pool of 1 and boss thread pool of 1 ?
3 Replies
Those values correspond to the three thread pools in Gremlin Server. The boss accepts incoming connections and passes them off to the worker pool - the boss stays at 1 typically. The worker pool handles non-blocking operations in the processing pipeline for a request - the worker default to 1 and it's typically acceptable there but you might go as high as the number of cores available. the worker will delegate blocking operations to the gremlinPool which is what does the query processing. if you set your gremlinPool to 1 you will get just one query processed at time. You usually want a number larger than than if your server can support it. I assume yours is set to 1 because you've stayed with the default configuration of 0 which then defaults to the number of available processors (i'd imagine you're on a small instance running Gremlin Server).
Thanks @spmallette for answering the query. Is there a ideal configuration mentioned for production systems, where we have 50millions+ vertices and edges, for fast query processing ?
not sure there is an ideal configuration. your workload, types of queries and graph structure of those millions of elements are all going to impact "fast query processing". i assume that with a
gremlinPool of "1" that output was coming from a test server of some sort and not your production system. i assume that when you move to production that number will be bigger by default. i'd just start with that and test your workload. then try some larger gremlinPool numbers and/or larger instance to see what effect it has if you're not satisfied.