database - C#: Very fast object search & retrieval using any persistence model -


i developing application fluent nhibernat/nhibernate 3/sqlite. have run specific problem need with.

i have product database , batch database. products around 100k batches run in around 11 million+ mark of now. when provided product, need fill combobox batches. not want load batches @ once because of memory constraints, loading them, when product provided, directly database. problem sqlite (or maybe combination of sqlite & nh) this, little slow. takes around 3+ seconds retrieve batches particular product. although might not seem slow scenario, want know can improve time? need sub second results make order entry smooth experience.

the details:

  • new products , batches imported periodically (bi-monthly).
  • nothing in persisted products or batchs ever changes (no update).
  • storing products not issue. batches main culprit.
  • product ids long
  • batch ids string
  • batches contain 3 fields, rate, mrp (both decimal) & expiry (datetime).

the requirements:

  • the data has stored in file based solution. cannot use client-server approach.
  • storage time not important. search & retrieval time is.
  • i open storing batch database using other persistence model.
  • i open using lucene, or nosql database (like redis), or oodb, provided based on single storage file implementation.

please suggest can use fast object retrieval.

thanks.

you need profile or narrow down find out 3+ seconds are.

is database fetching?
try running same queries in sqlite browser. queries take 3+ seconds there too? might need database, adding indexes.

is filling of combobox? if fill first value in combobox , throw away others? speed performance? might try beginupdate , endupdate.

are 3+ seconds else where? if so, find out where.


Comments

Popular posts from this blog

apache - Add omitted ? to URLs -

redirect - bbPress Forum - rewrite to wwww.mysite prohibits login -

php - How can I stop spam on my custom forum/blog? -