Tanvir
Explore posts from serversATApache TinkerPop
•Created by Tanvir on 3/6/2024 in #questions
Performance issue in large graphs
When performing changes in large graph (ca. 100K nodes, 500K edges) which is stored in one kryo file I am experiencing some huge delays. Just as an example, when writing initially I can change 10K nodes in minutes, but when the graph is big the same changes need more than one hour. Is there any easy solution possible, i.e., like breaking down and saving in smaller files etc. Any suggestion is helpful. Initial preference is saving in file system (local or network). Thanks for your suggestions/solutions.
9 replies
ATApache TinkerPop
•Created by Tanvir on 12/19/2023 in #questions
Exception saving as Gryo
When trying to save as gryo getting the error, Unable to create serializer "org.apache.tinkerpop.shaded.kryo.serializers.FieldSerializers" for class java.util.concurrent.atomic.AtomicLong. What could be the possible reason.
7 replies
JJanusGraph
•Created by Tanvir on 11/17/2023 in #questions
Speeding up node adding to Janusgraph
Hi Everybody, I am using Janusgraph with Berkley DB JE. In my use case I have to add initially nodes one by one. The number could be quite huge in certain cases, i.e., 200k-500k. It is currently taking quite some time, as compared to inmemory test setup.
Have tried the following to expedite and got some improvement:
.set("storage.berkeleyje.cache-percentage", CACHE_PERCENTAGE)
.set("cache.db-cache",true)
.set("cache.db-cache-size", DB_CACHE_SIZE)
private const val CACHE_PERCENTAGE = 80
private const val DB_CACHE_SIZE = 0.8
Cannot change the backend due to some limitations posed by customer.
Any suggestion for improvements are welcome.
Thanks and regards
Tanvir
2 replies
ATApache TinkerPop
•Created by Tanvir on 10/12/2023 in #questions
Can GraphBinary be used to save a graph to file?
Can GraphBinary be used to save graph in a file. Any example is welcome.
14 replies