• Feeds

  • MemcacheDB, Tokyo Tyrant, Redis performance test

    I had tested the following key-value store for set() and get()

    1. Test environment

    1.1 Hardware/OS

    2 Linux boxes in a LAN, 1 server and 1 test client
    Linux Centos 5.2 64bit
    Intel(R) Xeon(R) CPU E5410  @ 2.33GHz (L2 cache: 6M), Quad-Core * 2
    8G memory
    SCSI disk (standalone disk, no other access)

    1.2 Software version

    db-4.7.25.tar.gz
    libevent-1.4.11-stable.tar.gz
    memcached-1.2.8.tar.gz
    memcachedb-1.2.1-beta.tar.gz
    redis-0.900_2.tar.gz
    tokyocabinet-1.4.9.tar.gz
    tokyotyrant-1.1.9.tar.gz

    1.3 Configuration

    Memcachedb startup parameter
    Test 100 bytes
    ./memcachedb -H /data5/kvtest/bdb/data -d -p 11212 -m 2048 -N -L 8192
    (Update: As mentioned by Steve, the 100-byte-test missed the -N paramter, so I added it and updated the data)
    Test 20k bytes
    ./memcachedb -H /data5/kvtest/mcdb/data -d -p 11212 -b 21000 -N -m 2048

    Tokyo Tyrant (Tokyo Cabinet) configuration
    Use default Tokyo Tyrant sbin/ttservctl
    use .tch database, hashtable database

    ulimsiz=”256m”
    sid=1
    dbname=”$basedir/casket.tch#bnum=50000000″ # default 1M is not enough!
    maxcon=”65536″
    retval=0

    Redis configuration
    timeout 300
    save 900 1
    save 300 10
    save 60 10000
    # no maxmemory settings

    1.4 Test client

    Client in Java, JDK1.6.0, 16 threads
    Use Memcached client java_memcached-release_2.0.1.jar
    JRedis client for Redis test, another JDBC-Redis has poor performance.

    2. Small data size test result

    Test 1, 1-5,000,000 as key, 100 bytes string value, do set, then get test, all get test has result.
    Request per second(mean)key-value-performance-1(Update)

    Store Write Read
    Memcached 55,989 50,974
    Memcachedb 25,583 35,260
    Tokyo Tyrant 42,988 46,238
    Redis 85,765 71,708

    Server Load Average

    Store Write Read
    Memcached 1.80, 1.53, 0.87 1.17, 1.16, 0.83
    MemcacheDB 1.44, 0.93, 0.64 4.35, 1.94, 1.05
    Tokyo Tyrant 3.70, 1.71, 1.14 2.98, 1.81, 1.26
    Redis 1.06, 0.32, 0.18 1.56, 1.00, 0.54

    3. Larger data size test result

    Test 2, 1-500,000 as key, 20k bytes string value, do set, then get test, all get test has result.
    Request per second(mean)
    (Aug 13 Update: fixed a bug on get() that read non-exist key)
    key-value-performance-2(update)

    Store Write Read
    Memcachedb 357 327
    Tokyo Tyrant 3,501 257
    Redis 1,542 957

    4. Some notes about the test

    When test Redis server, the memory goes up steadily, consumed all 8G and then use swap(and write speed slow down), after all memory and swap space is used, the client will get exceptions. So use Redis in a productive environment should limit to a small data size. It is another cache solution rather than a persistent storage. So compare Redis together with MemcacheDB/TC may not fair because Redis actually does not save data to disk during the test.

    Tokyo cabinet and memcachedb are very stable during heavy load, use very little memory in set test and less than physical memory in get test.

    MemcacheDB peformance is poor for write large data size(20k).

    The call response time was not monitored in this test.

    如想及时阅读Tim Yang的文章,可通过页面右上方扫码订阅最新更新。

    « | »

    174 Comments  »

    1. a very detailed and meticulous lesson, it really has a lot of values, I will learn a lot thanks

    2. Thanks for great article!

    3. Draw poker may be the traditional way of poker and was played prolifically in high stakes cash games in the nineteenth century
      and early twentieth century. In addition, the poker rooms will not offer complete
      hand histories coming from all poker hands dealt on their site for analysis by outside
      sources. Make them think your cards are superior and don’t forget to maintain your emotionless look.

    4. That video about online games with Tony and Ezekiel was so funny, especially campfire moment.

    5. I will follow it to know more info and expand my data, and I think everyone should know it.

    6. Having people act within these laws would constitute virtuous behavior.

    7. Sam

      The article have full information which helps more. thank you sharing post.
      Accounting assignment help

    8. Oh, great, your article provided me with useful information and a fresh perspective on the subject.

    9. Awesome blog!! Thank you for providing such excellent information. If you are looking for help with choosing a research topic for your thesis/ dissertation then you can visit our site… Research Topic Help Service

    10. vivek

      Nice post.
      veri shades

    11. Calvin C. Sanchez

      Professional wedding DJ Services in the Philadelphia area. We provide a personalized music curation experience that makes your wedding unique and unforgettable. Let us turn your dream into reality with our top notch entertainment services. Philadelphia Wedding DJ

    12. Annalee Porter

      感谢您分享这一点。但是,因为是英文写的,所以我只懂一点。我们在 Interior Design Edmonton 的问候

    13. Abby

      this is a great article Gutter Cleaning Belleville thank you

    14. Awesome post thank you for sharing check article here bathroom contractor

    15. Kendrick

      Thank you so much for such an amazing article. I love it and I hope that there’s more to come.

      – Kendrick | https://www.landscapingbrantford.ca/landscaping-and-garden-installations

    16. Claire

      I appreciate the information in this article. I might wait for the next release. By the way, please visit our website to know more about our lawn mowing services around Orlean, ON. Thanks!

    17. Albert

      I believe that great articles come from great ideas from brilliant minds.

      landscapingmilton.ca/lawn-care-and-garden-maintenance

    18. Migoy

      Thank you so much for this kind of information. I hope that there’s more to come. I love it so much! By the way, please visit our website. Thanks!

    19. Army

      This kind of information is really amazing. I love to share this with my colleagues and friends so that they can also benefit. Thanks for this blog. I hope that there’s more to come.

      – Army K | bathroomrenovationslangley.ca/tub-and-shower-remodeling

    20. Kyla Smith

      Thank you so much for such an amazing article. I love it and I hope that there’s more to come.
      Kyla- kitchen remodeling fort worth tx

    21. Freddy

      I appreciate this kind of information. And I am happy to share this with my friends and colleagues. This will definitely give amazing information to all of us. Thanks for sharing by the way.

      – Tray | https://www.bathroomrenovationscambridge.ca

    22. Jomar

      Great work and good job! I love the structure of your blog. And I appreciate that you share this with us for free. I hope that you continue making blogs and post them on your website. Please send me an email for new blog posts. Thank you! By the way, please visit our website to know more about our affordable bathroom remodeling services. Here’s the link: https://www.bathroomrenovationsbrantford.ca/. Thanks!

    23. Fernan

      I appreciate those people who are dedicated to doing such informative blogs like this. I can’t imagine the intelligent mind used to do such amazing things. I do hope you continue doing this because as a student, we really appreciate this kind of information and consider this as a reference for future applications. By the way, please visit our website to know more about our affordable local duct cleaning services. Thanks!

    Leave a Comment