16.2.20

SSD vs. TB benchmarks

testing 1 NVME, the Adata SX8200, against a RAID5 array of 7 old HDDs (WD Red 3GB).

not sure which settings or stats to focus on here. all 4k randread, with varying depth queue (DQ) and test size.

DQ1 1GB (10x advantage to NVME)
  1. IOPS: NVME 12k RAID5 1.1k
  2. bandwidth: NVME 50MB/s RAID5 5MB/s
DQ1 latency test 256MB (70x advantage to NVME)
  1. NVME 189k RAID5 2.7k
  2. NVME 775MB/s RAID5 11MB/s
DQ64 1GB (100x to NVME)
  1. IOPS: NVME 297k RAID5 2.6k
  2. bandwidth: NVME 1200MB/s RAID5 11MB/s
DQ64 16GB (170x to NVME)
  1. NVME 288k RAID5 1.7k
  2. NVME 1200MB/s RAID5 7.1MB/s
4k randread depth queue 1, 1GB
fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=random_read.fio --bs=4k --iodepth=1 --size=1G --readwrite=randread
for the NVME (Adata SX8200)
test: (groupid=0, jobs=1): err= 0: pid=3056070: Sun Feb 16 21:50:12 2020
  read: IOPS=11.9k, BW=46.7MiB/s (48.9MB/s)(256MiB/5484msec)
   bw (  KiB/s): min=44376, max=50696, per=100.00%, avg=48058.30, stdev=2340.39, samples=10
   iops        : min=11094, max=12674, avg=12014.50, stdev=585.14, samples=10
 for the RAID5 (7 HDDs)
 test: (groupid=0, jobs=1): err= 0: pid=3055955: Sun Feb 16 21:50:02 2020
  read: IOPS=1162, BW=4650KiB/s (4762kB/s)(256MiB/56370msec)
   bw (  KiB/s): min= 1261, max=14640, per=99.54%, avg=4628.40, stdev=1391.54, samples=112
   iops        : min=  315, max= 3660, avg=1157.10, stdev=347.89, samples=112
4k randread depth queue 1, 256MB latency test
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test --filename=random_read.fio --bs=4k --iodepth=1 --size=256MB --readwrite=randread
for the NVME (Adata SX8200)
  read: IOPS=189k, BW=738MiB/s (774MB/s)(256MiB/347msec)
    clat (nsec): min=180, max=34881, avg=210.56, stdev=139.
for the RAID5 (7 HDDs)
   read: IOPS=2706, BW=10.6MiB/s (11.1MB/s)(256MiB/24213msec)
    clat (usec): min=54, max=88073, avg=365.22, stdev=1524.43
4k randread depth queue 64, 1GB
fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=random_read.fio --bs=4k --iodepth=64 --size=1G --readwrite=randread
for the NVME (Adata SX8200)
 test: (groupid=0, jobs=1): err= 0: pid=3053833: Sun Feb 16 21:31:07 2020
  read: IOPS=297k, BW=1160MiB/s (1216MB/s)(1024MiB/883msec)
   bw (  MiB/s): min= 1141, max= 1141, per=98.43%, avg=1141.44, stdev= 0.00, samples=1
   iops        : min=292209, max=292209, avg=292209.00, stdev= 0.00, samples=1
for the RAID5 (7 HDDs)
test: (groupid=0, jobs=1): err= 0: pid=3053935: Sun Feb 16 21:33:39 2020
  read: IOPS=2631, BW=10.3MiB/s (10.8MB/s)(1024MiB/99634msec)
   bw (  KiB/s): min= 6252, max=27320, per=99.30%, avg=10450.44, stdev=2091.69, samples=198
   iops        : min= 1563, max= 6830, avg=2612.61, stdev=522.92, samples=198
4k randread depth queue 64, 16GB
fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=random_read.fio --bs=4k --iodepth=64 --size=16G --readwrite=randread
 for the NVME (Adata SX8200)
for the NVME (Adata SX8200)
test: (groupid=0, jobs=1): err= 0: pid=3056599: Sun Feb 16 21:56:22 2020
  read: IOPS=288k, BW=1125MiB/s (1179MB/s)(16.0GiB/14568msec)
   bw (  MiB/s): min=  973, max= 1226, per=99.94%, avg=1124.02, stdev=74.61, samples=28
   iops        : min=249234, max=314076, avg=287749.50, stdev=19099.27, samples=28
for the RAID5 (7 HDDs)
 test: (groupid=0, jobs=1): err= 0: pid=3056790: Sun Feb 16 22:38:16 2020
  read: IOPS=1735, BW=6940KiB/s (7107kB/s)(16.0GiB/2417443msec)
   bw (  KiB/s): min= 3784, max=27408, per=100.00%, avg=6950.02, stdev=961.95, samples=4827
   iops        : min=  946, max= 6852, avg=1737.50, stdev=240.49, samples=4827

12.1.20

downloaded some TBs

wget -e robots=off -r -np -nd -nc --reject "index.html*,rtbz" --reject "robots*" http://tablebase.sesse.net/syzygy/7-WDL/

md5sum --ignore-missing -c MD5SUM.txt 2>&1 >> md5results.txt
md5sum: WARNING: 1 computed checksum did NOT match
[3]   Terminated              md5sum --ignore-missing -c MD5SUM.txt

8.1.20

raid adventures

create a raid array
sudo mdadm --create /dev/md/raid /dev/sda /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdg /dev/sdh --level=5 --raid-devices=7 --layout=left-symmetric --chunk=8192
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md/raid started.
mdadm: timeout waiting for /dev/md/raid

watch it sync

make file system
sudo mke2fs -t ext4 -b 4096 -E stride=2048,stripe-width=12288 -c -c /dev/md/raid


resources
https://raid.wiki.kernel.org/index.php/RAID_setup#Chunk_sizes
https://busybox.net/~aldot/mkfs_stride.html
suggests `mkfs.ext3 -b 4096 -E stride=2048,stripe-width=12288`
https://linux.die.net/man/8/mkfs.ext4
http://tablebase.sesse.net/syzygy/7-WDL/?C=S;O=A
https://raid.wiki.kernel.org/index.php/Monitoring_your_system#.2Fproc.2Fmdstat

6.1.20

life imitates art

how many more examples are there like this?

there are more examples of people using Trump as president as a ridiculous prediction.

exhibit 1: the Simpsons episde where Bart gets some award from President Trump in Lisa's daydream?

exhibit 2: Michael Moore directed the music video for Rage Against the Machine's Sleep Now in the Firein 1999. top YouTube comment: "he threw in the Trump for President sign (1:03) because he thought it was the most ridiculous and over the top thing he could think of..."

1.1.20

i am cyberpunk

in the year 2000...

https://www.reddit.com/r/cyberpunkgame/comments/eiifqr/countdown_to_the_dark_future_365_days_of

28.12.19

what is fiction? a quest to find a believable universe

I think one of the things I enjoy most in life is the "quest to find a believable universe" be it in fictional world-building or understanding reality, as the Scientific American terms it, shrewdly connecting the two. There is immense joy in placing a newfound idea on top of a cohesive pile of concepts that interweave, describing the mechanics of this world, sometimes in surprising ways, finding deeply hidden connections between seemingly disparate parts. This act of discovery, unearthing hidden beauty in the world, is euphoric and addictive.

Gaining an understand of the themes behind a piece of fiction creates commonality between the events within that world, thereby gaining a deeper understanding of the connections between its parts. That payoff of connecting different events is very satisfying, as evidenced by countless fan theories and widespread acclaim of works that are cohesively tied together by themes that run throughout, improving your understand with each new reveal like in Breaking Bad, or just highlighting absurd ironic similarities like in Arrested Development. I seem to enjoy most the fiction that belabours world-building and continues to amaze with increased understanding through continuous reveals, racing ever deeper into the true heart of knowledge. The plot and characters are but a means to better understand the world that contains and binds them.

Creating fiction that isn't internally consistent and "anything can happen" is not just unsatisfying, but also a slap in the face to any effort you may have already put into understanding the rules that tie together this fictional universe. It favours plot and characters over rationality and substance, destroying any chance of working away at a deeper truth in a world without internal consistency, in favour of plot with contrived conflict, character arcs that tug at the heart-strings, or sometimes, just pure spectacle.

Tolkien describes it well in his essay "On Fairy-Stories" saying
...in order for the narrative to work, the reader must believe that what he reads is true within the secondary reality of the fictional world. By focusing on creating an internally consistent fictional world, the author makes secondary belief possible. - Wikipedia: Suspension of disbelief

He describes art that immerses you into an entirely different world, by making it completely believable. Isn't that what all fiction does? Most fiction just uses the shortcut of basing that alternative reality on the world we experience around us:
"It is easier to produce this kind of “reality” with more “sober” material. Fantasy thus, too often, remains undeveloped; it is and has been used frivolously, or only half-seriously, or merely for decoration: it remains merely “fanciful.” Anyone inheriting the fantastic device of human language can say the green sun. Many can then imagine or picture it. But that is not enough — though it may already be a more potent thing than many a “thumbnail sketch” or “transcript of life” that receives literary praise." - J.R.R. Tolkien, care of brainpickings.org
 He does so not without throwing a good bit of shade, towards Shakespeare no less:
"Macbeth is indeed a work by a playwright who ought, at least on this occasion, to have written a story, if he had the skill or patience for that art." - J.R.R. Tolkien, care of brainpickings.org
 It isn't founded in the suspension of disbelief, but rather is defined by the absence of it:
"the moment disbelief arises, the spell is broken, and more specifically of fairy-stories, the "magic" or rather, the art has failed. You are then outside in the Primary World again, looking at the little abortive world." - J.R.R. Tolkien, care of Subcreation - Writing Middle-Earth
 It inherently contrasts to and provides commentary to reality built on "logic" and the "recognition of fact" without which his Fantasy couldn't exist.
"If men really could not distinguish between frogs and men, fairy-stories about frog-kings would not have arisen." - J.R.R. Tolkien, care of brainpickings.org
In a world where people's grasp on reality and facts is despairingly low, no wonder we can't distinguish between fact and fiction and we increasingly prefer fantasy that isn't grounded in reality. So why bother being critical of what's before our eyes and assign deeper meaning, if anything can happen and nothing matters? Or should I say No wonder it increasingly feels like life is imitating art, as what would have once been considered fantasy is now fact, the boundaries of our rational reality are blurring, leading to dispassionate detachment from an absurdist world that requires ever more emotional toil to make sense of, resulting in avoidance and withdrawal into simpler constructs that make sense and don't provide constant sources of cognitive discomfort:
A person who experiences internal inconsistency tends to become psychologically uncomfortable - Wikipedia: Cognitive dissonance
This sounds exactly like the battle plan of certain state actors nowadays (Nothing Is True and Everything Is Possible: The Surreal Heart of the New Russia). If not all those battling the modern warfare of controlling our realities. Exhaust and frustrate arguments you can't win. Bring everyone down into the mud with baseless accusations, that require a lot of emotional toil to keep up with, and even moreso to discount (sealioning and whataboutism and more*).
"Never believe that ______ are completely unaware of the absurdity of their replies. They know that their remarks are frivolous, open to challenge. But they are amusing themselves, for it is their adversary who is obliged to use words responsibly, since he believes in words." - Jean-Paul Sartre, care of a guy on /r/AdviceAnimals
* Ad hominem (you're so triggered right now),  Straw Man (we can't all switch to electric vehicles, it's impossible), Hasty Generalization (carbon tax hasn't reversed climate change yet, so let's throw the baby out with the bath water), Moral equivalence (good people on both sides). good list found here.
found another one here: context stripping, removing all nuance puts an immense burden of proof on the audience to question a soundbite, which most won't bear, and rather accept it as truth.


sidebar: examples of spectacle over substance

Game of Thrones
  1. pushing Bran out of a window to cover up an incestuous affair between narcissists* versus Jaime/Cersei accidental rape scene that makes no sense and serves no  purpose but shock value (relevant Dragon Demands on YouTube). one of those narcissists almost attains a redemption arc before one-night-standing Brianne, destroying her character's theme of blinding service to a cause by turning her into a blubbering emotional mess, before running back to get crushed to death in a basement with Cersei. no, guys, character arc doesn't mean physically returning from later bang to prior bang. but no one expected that, so spectacle created!
  2. D&D takeover completely subverting expectations of internal consistency ("I have no idea why my character did any of this") in order to "show off the actor" and create emotional or visual set-pieces (relevant Dragon Demands on YouTube).
Star Wars The Rise of Skywalker
  1. Opening scene TIE fighters can now hyperspace jump even though their inability to do so was a repeated plot point in A New Hope (Ben Kenobi: "A fighter that size couldn't get this deep into space on its own.").
  2. Po does 4 hyperspace jumps in a row even though famed bad-ass Han Solo refused to bear the risk of a single one while using hyperspace to escape from his less-able TIE fighter assailants ("Traveling through hyperspace isn't like dusting crops, boy! Without precise calculations we could fly right through a star or bounce too close to a supernova and that'd end your trip real quick, wouldn't it?").
  3. Repeated one-uppance in the balance of galactic space power, summoning all-powerful fleets out of thin air only to have them be one-upped moments later, completely destroying any feeling of substance in the contrived conflict of the space battle fought by all the movie's characters and space horsies *sans* Palpatine, Rey, and Kyloo, fighting the only battle that matters in the throne room. The appearance of a 10,000 times stronger force instantly makes irrelevant all existing navies, creating a momentous do or die battle to snuff it out before its artificially created 16 hour levitation timer expires, though I guess that doesn't matter, since it seemed to still be fighting at full strength and was easily going to destroy the good guys had the brand new even better and stronger friendship-powered good guy fleet not arrived in the nick of time. what's their force level at that point? Vegeta, can we get a power level reading? 10,000 squared? shall we switch to scientific notation for ease? 10^8 it is. why didn't those good guys heed the call in the move just 1 prior to this one? they put a lot more effort into that call for help than just "hey go ask around" in this one, but hey I guess our expectations were subverted when doing the same thing twice succeeds with no explanation whatsoever (an author was given the miserable task of coming up with an excuse: the baddies put them all in super secret jail, and when the Rebellion freed them, used the *Vader's List* of sympathisers to make all new friends).
  4. Zombie Palpatine killing himself because after recently levelling up his force lightning skills to gain fleet-destruction ability he forgot to put any points into an off switch for said same crucial skill, which would have come in super duper handy as his fleet-killing lightning is reversed by not one, but two lightsabers wielded by a not-yet-Jedi not-yet-a-Skywalker. Did he not learn anything from when Anakin had to save his ass from Mace Windu single-lightsaber-blocking his lightning 3 movies ago? Or maybe he was fake-dying back then, in order to have Anakin finally turn to the dark side by  This was a necessary plot device to avoid having Rey kill him directly, which would have her fall into his whole "strike me down" dastardly plan that seems eerily familiar from 6 movies ago, and countless iterations of dastardly plans . I guess a physical act can't be detached from its emotional connection? killing = bad all the time, guys, and you should always feel bad about it, except for all the countless stormtroopers which you should only have feels for when they take their helmets off. Having Kylo kill him wouldn't have him attain his redemption arc turning away from his dastardly plan for galactic conquest by magically turning to the light side because his mommy force-possessed him from across the galaxy into hallucinating a *really good* vision of his dad that finally succeeds into guilting him about the whole patricide thing only while weakened by some momentary lightsaber impalation, after he had just put aside any qualms on his way to his next front-stab, of his newfound zombie master.

26.12.19

troubleshooting google play music desktop player on clear linux

the library wouldn't load. using the build from issue 3650 fixed it. but then I couldn't sign in. a totally separate issue, resolved here (issue 3545) by installing the latest release from this handy webpage. everything was working. then I clicked the "try YMP (beta)" and it fails, and I can't revert, even after deleting everything and replacing the files. how the fuck? turns out there's some .config file i can delete to reset it as per my frustration in PR 3647.

solution is deleting the whole Google Play Music Desktop Player folder under .config did the trick. loads up like a fresh install.