[Neo] Java outof 64 GB ram

Miguel Angel Aguila maguila at ac.upc.edu
Fri Feb 26 18:19:37 CET 2010


Ok, thank you.
I've been thinking and I can change the String of node type for an integer.
I'll change it and some other things and will try to execute another time,
when the trials finishes I will comment you how have it gone.

Mike

2010/2/26 Mattias Persson <mattias at neotechnology.com>

> If it would be possible to have the "node type" as an integer it'd be
> more space efficient. Also if you just need the "node type" for
> lookups you don't need to set such property on the node, it could be
> enough to just index it.
>
> With those data you provided your string property store should be 28G,
> I'm guessing the rest is String properties on relationships?
>
> 2010/2/26 Miguel Ángel Águila <maguila at ac.upc.edu>:
> > Yes, one of them is "node type", but I need because I also use this
> > property for indexing depend on the kind of node.
> >
> >
> >
> > El vie, 26-02-2010 a las 13:11 +0100, Mattias Persson escribió:
> >> 2010/2/26 Miguel Ángel Águila <maguila at ac.upc.edu>:
> >> > I will explain me better.
> >> > Every node has:
> >> > - One String that have 5 chars.
> >> > - One String that have 3 chars.
> >> > - One String that have 4 chars.
> >> > - One String that have 100 chars.
> >> Is one of them any kind of "node type"? Because often you can infer a
> >> type from its relationships or surrounding environment, making that
> >> property redundant in a way. (nodes can often represent one or more
> >> logical entities, hence a single type wouldn't suffice and that's why
> >> it isn't built in to the API).
> >> >
> >> > Mike
> >> >
> >> > El vie, 26-02-2010 a las 10:05 +0100, Miguel Ángel Águila Lorente
> >> > escribió:
> >> >> I don't know if I'm answering your question but every node has 4
> pairs
> >> >> of String, therefore 4 pairs of char(15).
> >> >>
> >> >> Mike
> >> >>
> >> >>
> >> >>
> >> >> El jue, 25-02-2010 a las 07:18 -0700,
> >> >> rick.bullotta at burningskysoftware.com escribió:
> >> >> > Yes, exactly the question.  If it's a big string, it is quite
> possible
> >> >> >    to have the file grow this large.
> >> >> >
> >> >> >
> >> >> >
> >> >> >    Miguel, approximately how long is the property value?
> >> >> >
> >> >> >
> >> >> >
> >> >> >    -------- Original Message --------
> >> >> >    Subject: Re: [Neo] Java outof 64 GB ram
> >> >> >    From: Johan Svensson <johan at neotechnology.com>
> >> >> >    Date: Thu, February 25, 2010 7:13 am
> >> >> >    To: Neo user discussions <user at lists.neo4j.org>
> >> >> >    If you store 322M strings (one string property/relationship),
> were
> >> >> >    each string is 200 bytes, the string store will be 60GB+ in
> size.
> >> >> >    How large are the strings you are storing?
> >> >> >    -Johan
> >> >> >    On Thu, Feb 25, 2010 at 2:55 PM, <
> rick.bullotta at burningskysoftware.com>
> >> >> >    wrote:
> >> >> >    >   The string propertystore file seems really, really large to
> me,
> >> >> >    based
> >> >> >    >   on the # of nodes/relationships/properties.  The reason I
> ask is
> >> >> >    that I
> >> >> >    >   saw similar behavior in some of our early testing.
>  Extremely large
> >> >> >    >   string propertystores file.  It would be helpful to
> understand why
> >> >> >    the
> >> >> >    >   file gets that large, and whether it is related to some of
> the
> >> >> >    memory
> >> >> >    >   stress issues.
> >> >> >    >
> >> >> >    >
> >> >> >    >
> >> >> >    >
> >> >> >    >
> >> >> >    >   -------- Original Message --------
> >> >> >    >   Subject: Re: [Neo] Java outof 64 GB ram
> >> >> >    >   From: Miguel ngel_guila Lorente <maguila at ac.upc.edu>
> >> >> >    >   Date: Thu, February 25, 2010 1:57 am
> >> >> >    >   To: Neo user discussions <user at lists.neo4j.org>
> >> >> >    >   There are 322 million relationships, no 57 million
> relationships.
> >> >> >    The
> >> >> >    >   only propierty I save in the relationship is a String. In
> this 322
> >> >> >    >   million relationships there are 3 diferents types of
> relations.
> >> >> >    >   Do you think that 13 GB is a strange number? Why?
> >> >> >    _______________________________________________
> >> >> >    Neo mailing list
> >> >> >    User at lists.neo4j.org
> >> >> >    [1]https://lists.neo4j.org/mailman/listinfo/user
> >> >> >
> >> >> > References
> >> >> >
> >> >> >    1. https://lists.neo4j.org/mailman/listinfo/user
> >> >> > _______________________________________________
> >> >> > Neo mailing list
> >> >> > User at lists.neo4j.org
> >> >> > https://lists.neo4j.org/mailman/listinfo/user
> >> >>
> >> >>
> >> >> _______________________________________________
> >> >> Neo mailing list
> >> >> User at lists.neo4j.org
> >> >> https://lists.neo4j.org/mailman/listinfo/user
> >> >
> >> >
> >> > _______________________________________________
> >> > Neo mailing list
> >> > User at lists.neo4j.org
> >> > https://lists.neo4j.org/mailman/listinfo/user
> >> >
> >>
> >>
> >>
> >
> >
> > _______________________________________________
> > Neo mailing list
> > User at lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
>
>
>
> --
> Mattias Persson, [mattias at neotechnology.com]
> Neo Technology, www.neotechnology.com
> _______________________________________________
> Neo mailing list
> User at lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>


More information about the User mailing list