[Neo4j] Neo4j Tuning for specific application
mattias at neotechnology.com
Sat Jul 10 21:16:47 CEST 2010
Are you using kernel/index version 1.0? Regarding the index lookups (each
lookup in its own separate transaction): I think there's a bug in
neo4j-index 1.0 which causes such a transaction (which contains a call to
index.getNodes) to write stuff to and flush the logical log, which of course
is completely unnecessary. That may very well be the cause of the disk being
so heavily used.
What you could try is to update to latest kernel/index version 1.1-SNAPSHOT
where this problem have been fixed, also in that version you aren't forced
to wrap reads in transactions. If you cannot update to latest 1.1-SNAPSHOT
then try to do more "cui"s in the each transaction.
2010/7/10 Arjen van der Meijden <acmmailing at tweakers.net>
> Hi Amir,
> I'm just starting with neo4j, but saw some issues with your code from a
> normal java-standpoint. Please note, some of them are just
> micro-optimizations that may not matter much. But a lot of them are in
> your critical path, so perhaps they're worth a look.
> On 10-7-2010 17:59 Amir Hossein Jadidinejad wrote:
> > Hi,
> > I have a GraphDB with the following attributes:
> > Number of nodes: 3.6M
> > Number of relation types: 2
> > Total size of DB: 9GB
> > lucene : 160MB
> > neostore.nodestore.db : 31MB
> > neostore.propertystore.db : 2GB
> > neostore.propertystore.db.strings : 4GB
> > neostore.relationshipstore.db : 1.5GB
> > Machine characteristics:
> > vm.dirty_background_ratio = 50
> > vm.dirty_ratio = 80
> > OS: Ubuntu x64
> > CPU: Corei7
> > MEM: 12GB
> > The following is our running scenario (The source code is attached):
> > 1. Iterate over all nodes and extract a list of node IDs ("fillNodes"
> > 2. For each node ID, initiate a worker thread that process the following
> > (8 threads are executed in parallel using a pool - "walk" function):
> > -extract relationships of this node.
> > -perform a light processing.
> > -update results (in a ConcurrentHashMap).
> > Note that:
> > -The above scenario is iterative. Roughly it runs 10 times.
> > -No update is applied to the DB during running (read only).
> > After running the application:
> > -Less than 4GB/12GB of memory is occupied. It seems that Neo4j is
> > only 2GB of memory.
> What jvm-flags did you specify? I take it, you didn't forget to include
> a high -Xmx, to allow more memory and perhaps the parallel 'old
> generation' garbage collector to allow more throughput. Otherwise, most
> 64-bit jvm's start with system-dependent maximums (afaik at most 2GB).
> > -The hard disk is overloaded.
> > -Only less than 20% of 8 cores is utilized in average.
> What is your disk doing? Reading, writing, seeking? (see iostat, iotop
> or similar tools, if its seeking, you see just a few mb/sec reads and no
> writes). You have actually 4 real cores, the other 4 are just
> hyperthread-cores which may alleviate some of the work-load if you're
> cpu-bound. If you're disk-bound, you may actually overwhelm your disk
> even further with all the additional threads.
> > Some documents are available in the wiki regarding performance
> > Guide, Configuration Settings, Linux Performance Guide). They are so
> > Would you please instruct me to have a better memory map and speed up my
> > application?
> > I can benchmark different configurations and reflect the results in the
> wiki for
> > future users.
> > Kind regards,
> > Amir
> Have you checked which parts of your application take a long time? Is it
> the fillNodes as well as the walk-methods? Or only the walk-variant. A
> decent profile may be useful.
> Are you sure you need to first retrieve all nodes, than store the
> cui-property in a hashset and than re-retrieve that same node via the
> index? It sounds to me, it should be possible to actually start working
> on the node right away? Or are your multiple threads (and thus the
> separate transactions) working against you here?
> Apart from that, I see a few things that may actually cost a bit of
> - You're storing unique (?) values in a hashset, to iterate them later.
> An arraylist is faster for this scenario and uses less memory.
> - You're boxing and unboxing Double's continuously to and from double's
> (for instance your 'temp' and 'result'). I don't know how many of these
> the jvm is able to optimize away, but preventing them to begin with may
> save a few cpu-cycles per iteration.
> - You're recalculating 1 - alpha needlessly.
> - You're using Math.pow rather than diff = v1 - v2; diff_value += diff *
> diff, the latter has no serious mathematical side-effects (afaik) and
> should be a bit faster.
> - You're starting many transactions (for each cui you process), without
> modifying your graph. I've no idea how heavy these are (relative to the
> rest of your application), so you may or may not have a need to reduce
> the amount of transactions. With the above mention of a list it should
> be relatively easy to adjust your walkerthread to process several cui's
> rather than just one by using sublist's.
> - You're retrieving the reference node for each iteration, rather than
> just once outside the loop in fillNodes.
> - Why are you converting the weight-property to a string, to then
> convert it to a Double? If its stored as a string, perhaps it'd be a
> good idea to change it to a Double?
> - Perhaps the cui-value can also be stored in a more efficient storage
> format (long?), thus saving space and memory.
> - Why are you filling v_star if you're not using the result?
> Best regards and good luck,
> PS, shouldn't a random walk do some random stuff?
> Neo4j mailing list
> User at lists.neo4j.org
Mattias Persson, [mattias at neotechnology.com]
Hacker, Neo Technology
More information about the User