Is it possible to boost up views/indexes creation in couchdb by multiple cores? -
we have converted database of app run-time logs mysql couchdb. there around 3m docs converted, occupy around 7gb.
then scripted out our first view (with reduce function) , did query invoke first run of view, make out view creation/generation. should take time , did 'top' on machine see process/cpu load stuff. noticed there 2 heavy process:
beam.smp couchjs
it's interesting seems occupy 1 core, there 4 cores on machine. possible make couchdb make use of multiple cores while creating/updating views?
currently not supported. guess multicore support add complexity couchdb.
so far, couchdb chooses simplicity instead of features. (did know couchdb 18,000 lines of code? compare 1 million in mysql or 100,000 in sqlite.)
when design document view index building, uses 1 couchjs
process. if have multiple design documents, will run in parallel. couchdb spawn 1 couchjs
process per design document, , os spread them across multiple cores.
however, if need performance, bigcouch apache couchdb-compatible , does support parallelized view index building using oversharded architecture.
Comments
Post a Comment