<oembed><type>rich</type><version>1.0</version><author_name>npub16cadfx8ew8z4qmsmsd9kndvntt4uad7vsdmkjer4jd8wjq4swxrqp2gy5d</author_name><author_url>https://nostr.ae/npub16cadfx8ew8z4qmsmsd9kndvntt4uad7vsdmkjer4jd8wjq4swxrqp2gy5d</author_url><provider_name>njump</provider_name><provider_url>https://nostr.ae</provider_url><html>📅 Original date posted:2012-07-24&#xA;📝 Original message:Hi Michael,&#xA;&#xA;from what I have noticed, bitcoin blockchain download/verfication all&#xA;happens in 1 thread.  (so multicores doesnt really help)&#xA;&#xA;That said, I have never tried on an ssd.&#xA;&#xA;What I do have is 6 SATA 6gbs configed as RAID0 Drives.&#xA;32gb of ram. ubuntu 64 (yeah I know), this runs upto 16 VM&#39;s&#xA;(I have 4 of these)&#xA;&#xA;However I have not tried to download the blockchain on the master os,&#xA;just in virtulisation.  However, the dedicated machines that I have been&#xA;using for benchmarking the VM&#39;s against is a q6600 8gb ram sata2 hdd -&#xA;Win 7 (seems faster than slackware...) to me it has always felt like&#xA;network bandwidth was the issue.  I might instrument the bitcoin-qt exe&#xA;to only pick low ping nodes (has someone already done this?)&#xA;&#xA;I guess it is time to start some benchmarking (like the gpu comparison page)&#xA;&#xA;hte verification for the 5 past 5 days was negliglable. I am off on a&#xA;flight to australia tomorrrow, so I will set some breakpoints and do&#xA;some timings in a debugger.&#xA;&#xA;This will all happen on an e-450 (wonderful machine!)&#xA;&#xA;Thanks very much for your response. it would seem that I am &#39;doing it&#xA;wrong&#39; :/&#xA;&#xA;cheers mate,&#xA;&#xA;steve&#xA;&#xA;(this message isnt signed because I have forgotten my password.)&#xA;&#xA;On 24/07/2012 09:25, Michael Grønager wrote:&#xA;&gt; Hi Steve,&#xA;&gt; &#xA;&gt; 45-90 minutes - note that its numbers from March/April, so a bit&#xA;&gt; longer today, but far, far away from the 12 hours.&#xA;&gt; &#xA;&gt; I am using libcoin and the bitcoind build based on this. Libcoin is&#xA;&gt; based on the Satoshi client, but refactured to use an async&#xA;&gt; concurrency model. I also did a minor tweeks to the db parameters. It&#xA;&gt; has earlier been tested up against Satoshi bitcoin where on some&#xA;&gt; OS&#39;es it performs similarly (at least on some linuxes) and on some&#xA;&gt; faster (e.g. mac).&#xA;&gt; &#xA;&gt; What is your CPU load during a block download ? (both initially/up to&#xA;&gt; the point where verification sets in and after). The initial download&#xA;&gt; is typically disk I/O bound, the verification stage CPU bound, though&#xA;&gt; I lean to believe that even there it is disk I/O bound (at least on&#xA;&gt; my system ~50% CPU load). What should be better in libcoin is the&#xA;&gt; concurrency model. The Satoshi client uses a pure reentrant mutexes&#xA;&gt; model, that is not generally believed to motivate the best coding&#xA;&gt; practice nor performance, you might end up without the concurrency&#xA;&gt; you initially strived for *). As mentioned earlier libcoin uses a&#xA;&gt; pure async concurrency model (and so does libbitcoin btw).&#xA;&gt; &#xA;&gt; I would like to stress again that these numbers will depend largely&#xA;&gt; on the system running the test - I would call my laptop a bit over&#xA;&gt; the average today (MB Pro, 2.66Ghz i7 dual core, 8GBRAM, 512GB SSD).&#xA;&gt; But again 12 hours - I only reach such numbers on some of my VPS&#39;es&#xA;&gt; (linode 1024) that are known for notoriously slow disk I/O. (here I&#xA;&gt; have a few % CPU load during the verification indicating indeed that&#xA;&gt; the disk i/o is the culprit).&#xA;&gt; &#xA;&gt; Cheers,&#xA;&gt; &#xA;&gt; Michael&#xA;&gt; &#xA;&gt; &#xA;&gt; *) I like this Dave Butenhof quote: &#34;The biggest of all the big&#xA;&gt; problems with recursive mutexes is that they encourage you to&#xA;&gt; completely lose track of your locking scheme and scope. This is&#xA;&gt; deadly. Evil. It&#39;s the &#34;thread eater&#34;. You hold locks for the&#xA;&gt; absolutely shortest possible time. Period. Always. If you&#39;re calling&#xA;&gt; something with a lock held simply because you don&#39;t know it&#39;s held,&#xA;&gt; or because you don&#39;t know whether the callee needs the mutex, then&#xA;&gt; you&#39;re holding it too long. You&#39;re aiming a shotgun at your&#xA;&gt; application and pulling the trigger. You presumably started using&#xA;&gt; threads to get concurrency; but you&#39;ve just PREVENTED concurrency.&#34;&#xA;&gt; &#xA;&gt; &#xA;&gt; &#xA;&gt; &#xA;&gt; On 23/07/2012, at 17:54, steve wrote:&#xA;&gt; &#xA;&gt; Hi Michael,&#xA;&gt; &#xA;&gt; On 23/07/2012 10:00, Michael Grønager wrote:&#xA;&gt;&gt;&gt;&gt; I get a full blockchain from scratch in 45 minutes on my&#xA;&gt;&gt;&gt;&gt; laptop, /M&#xA;&gt;&gt;&gt;&gt; &#xA;&gt; Hang on a sec, in 45 minutes you can download the entire chain from &#xA;&gt; the genesis block?&#xA;&gt; &#xA;&gt; I have been doing extensive testing in this area and would love to &#xA;&gt; know what is special about your setup (I have never had the entire &#xA;&gt; chain in under 12 hours, infact it is normally closerto 24.) I have&#xA;&gt; an extensive setup of test machines, everything from e4300 to&#xA;&gt; phenom2x6 to i5&#39;s.&#xA;&gt; &#xA;&gt; as an example on an amd e-450 with 4gb ram, and approx 3gb/s&#xA;&gt; internet connection it took 2 hours to sync the last 5 days.&#xA;&gt; &#xA;&gt; Maybe i am missing something important...&#xA;&gt; &#xA;&gt; Any additional information that you could provide to help me with &#xA;&gt; testing would be really appreciated.&#xA;&gt; &#xA;&gt; cheers,&#xA;&gt; &#xA;&gt; steve&#xA;&gt; &#xA;&gt;&gt; &#xA;&gt;&gt; ------------------------------------------------------------------------------&#xA;&gt;&gt;&#xA;&gt;&gt; &#xA;Live Security Virtual Conference&#xA;&gt;&gt; Exclusive live event will cover all the ways today&#39;s security and &#xA;&gt;&gt; threat landscape has changed and how IT managers can respond.&#xA;&gt;&gt; Discussions will include endpoint security, mobile security and the&#xA;&gt;&gt; latest in malware threats.&#xA;&gt;&gt; http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ &#xA;&gt;&gt; _______________________________________________ Bitcoin-development&#xA;&gt;&gt; mailing list Bitcoin-development at lists.sourceforge.net &#xA;&gt;&gt; https://lists.sourceforge.net/lists/listinfo/bitcoin-development&#xA;&gt; &#xA;&gt; &#xA;&gt; &#xA;&gt; &#xA;&gt;</html></oembed>