drive failure on backup day?

Someone said it was 'backup day' or 'backup week' or something similar. Co-incidentally, I had a drive fail in my backup disk array. The picture shows the disk out of its normal NAS enclosure and being examined in one of those hard drive docking stations.

I've already replaced it with a fresh disk in the Drobo and didn't even need to take the server offline.

The last 6 Terabyte drive failed about a year ago, and was in the same unit, but a different slot.

I decided to look at mean time between failure on these devices. I've quite a few Western Digital RED drives for servers and have a pretty good experience with them. Mine are mainly 3 Terabyte (15T packs) and 6 Terabyte (30T packs). By the time they have a single or dual disk redundancy, the available space diminishes somewhat.

It still seems crazy large compared with my oldest disk computers which had something like 2x32Mb disk drives.

Nowadays, I should probably be storing all of that data in the cloud (it's not like I need it all at once), although I'm still somewhat nervous about the way various services just come to an end. A recent example is the termination of the Amazon cloud storage of personal music libraries, which isn't allowing any new things to be uploaded after the end of 2018.

I like the stats that backblaze keep on disk failure rates, from their server farms, as a quick way to get a sense of relative failure rates, from a population of about 90,000 drives.

Pig and Whistle

An expedition to the Pig & Whistle, out in the Essex countryside. I know there's a lot of Pig 'n Whistle bars in America, but the pictures of pigs with whistles is a somewhat more literal translation than what I think of as Pig and Whistle, which is more or less a piggen wassail. That's a bowl or jug of beer which gets dunked/poured with individual beer mugs.

It used to be a thing in London, around some part of the City. Draft bitter sometimes gravity-fed from the barrel into a jug/pitcher and then distributed around the table.

Mainly just 4 and 8 pints, but nowadays it has almost completely disappeared except for the buckets of beer, which is simply iced (usually foreign lager) bottled beers bought in units of around 5. Those sawdust floored real ale pubs, underneath railway arches and lit by candles have been progressively replaced with Weatherspoons or expensive cocktail bars.

But back to the country pub in Essex. It serves a lovely Sunday carvery. Oh yes.

saddled with it

A chance for some family catch up, although there were several comments about my apparent hole-digging cycling performance. I sometimes forget how far and wide the Garmin statistics get spread via tapiriik and other systems.

When I use turbo mode then it does look as if I'm prospecting for oil. I know I sometimes come back thinly covered in it, but I think that's the chain fighting back.

Bookish magical realism

A stop off in Piccadilly at the Edward Lutyens designed Maison Assouline, partly to look at the rather expensive books, and partly to tipple one of the rather expensive cocktails. The sign outside might say books, gifts and cafe, but it is a rather understated indication of the model Ferraris, coffee table Andy Warhols and afternoon teas on offer.

I decided to try the tequila based Frida Kahlo, which somehow matched the book on display just in front of me. Or maybe it was subliminal advertising? Magical realism?

CDs vs digital - a listener's licence?

Before we moved I did a rationalisation of vinyl music. Around an 80% cull. We do still have a record player, but it is somewhat decorative nowadays, akin to those vintage typewriters that are making a comeback. A few special albums and ones with extra memories survived, but the rest (often duplicated as CDs) are doing the rounds of charity shops.

The next set of items to follow my old bright orange Olympia Traveller de Luxe out of the door, could be my CDs.

Ages ago I started removing CDs from jewel cases, to get around a 5:1 space reduction. They spent some time in plastic binders, but then as we went digital, the CDs started to migrate into crates. Never a good sign.

Currently the crates are in the garage, awaiting the next set of decisions.

Do I build some shelving to bring them back indoors? My artistic recreation of shelving suggests not. And if I did, would they ever be browsed and would individual CDs get played the way they were when there were far fewer and they had a dedicated Hi-Fi system?

I somehow doubt it. I know all about the higher quality of the CDs compared with .mp3 and FLAC encoding. More dynamic range. On headphones with some I can even tell the type of tape used on old analogue to digital conversions of albums.

Would that it were so simple.

Convenience will win out. Being able to think of an album and just play it still wins over rummaging around through racks of CDs in most cases. Even playlists for those Chilled Afternoon Coffee Moments Where Even Stereo Is Unimportant.

I guess there will be exceptions. Some CDs with elaborate cases that are still akin to artwork. A few with extra special memories, but the bulk are really a way to be able to prove that I have the licence for a particular set of music.

I haven't started the physical process yet.

fedora hat man

That new movie Unsane with Claire Foy as the leading character is a sort of stalker take on a Gaslight movie. Whilst with some sunny outdoor moments, it's set largely within a hospital and oft-times inside the head.

Close quarters and dimly lit, it was entirely made on iPhones. It makes me wonder how the techniques for iPhone and very small camera based movies will develop. Some of the static well-lit scenes have incredible detail, other major story-telling parts go somewhat murky and dare I say blurry.

For monochrome movies there developed all kinds of back-light/rim light techniques to set the right noir tones. You almost can't have a noir without one of those shutters/blinds scenes and some of that cigarette smoke...For Canon/Lumix/RED style big lens digital there's a chance to show off creamy blurry depth of field.

Now with the tiny cameras, away from Top Gear style saturation and magic bullet post-processing, there'll presumably be a whole new set of techniques? I suppose this movie is something of a trailblazer. All the way from selfies to wide-screen?

Here's a trailer for the movie, although, by way of a warning, it is one of those that partially summarises the plot.

now with added alligators - the $1.3T omnibus snow job doesn't drain the swamp

That $1.3 trillion omnibus bill was passed in the USA, partly using a ticket to avert a further US government shutdown.

It doesn't drain the swamp, it just adds more alligators, mud, live oak, gumbo limbo, royal palm and sharp saw palmettos.

Firstly, check it out (here). The 2,232 pages are almost unreadable. It's built by weight. I expect they work out the consultant fee at so many thousand dollars per page. And the need for it to have the thud factor because its for $1.3 trillion.

There's no embedded tables, it uses arbitrarily split sentences, spaced on around 8 word numbered lines.

There's no headers and footers so you have to guess where a section starts. There's no proper summary. It has all the hallmarks of a snow job and a shopping list for vested interests. Just send your requests to our consultants and we'll put them through the obfuscation mill. Here's an example from the tax simplification area - the so-called General Deadwood Related Provisions:

Yikes.

Already the media headlines are about bike sheds New Jersey tunnels and the wall, although the really big money seems to go to the military. The Pentagon gets around $656 billion of the $1,300 billion. Some 50.4% of the total, but its buried away in Section C. The new ultra-hawkish John Bolton as national security advisor has previous form for wanting to bomb places, so watch out.

I decided to take a look at a simple area: the new warplanes being acquired as part of the defence upgrade. Here's my table:

I casually picked the first item to examine in more detail. F-35 planes. Lockheed had agreed to deliver them for 'less than $100m each'. Not so here, with a per unit cost of $113 million. Maybe it's somebody's handling fees? A kind of swamp tax.

that elusive facebook delete button

A lot of people talk about deleting Facebook, but I doubt whether many will. It's also incredibly difficult to find the delete button. I've decided to put a copy here, in case I ever need it. My summary shows there's only so many categories they can track, after all:

And here's a link to a fuller infographic of all of the Facebook marketing/targeting capabilities. What's all the fuss about? They still think I live in a place called Chelsea, Newham, London and have self-generated fictitious home moves. A recent example of their marketing was this irrelevant stuff about prayer candles and a curiously named toilet seat.

Maybe they thought it looked a similar shape to a recent art exhibit I visited called not everyone will be taken into the future? Maybe I should name their combo "Not every social media site will be taken into the future"?

Cambridge Analytica : the dice were loaded from the start?

Above is Wired's postulation of Mark Zuckerberg's current appearance and the Damian Collins MP letter to him at 1 Hacker Way, Menlo Park. Since the news about Facebook and Cambridge Analytica (CA), he has yet to comment. Whoever is managing facebook's reputational damage needs to step it up a notch.

The absent Mark Zuckerberg and Sheryl Sandberg are presumably being schooled in media answers, whilst Facebook lawyers such as Paul Grewal advise staff on how to remain silent. It looks as if each organisation implicated is selecting a scapegoat to try to minimise damage. Kogan and Nix so far.

Facebook's security model goes back to something called IETF RFC 6749/OAuth 2.0, which is a multi-tier way to seek permissions and which in turn allow access to friend data.

Facebook third party developers were encouraged to use these friends permission protocols to monetise and to extend their own networks.

It means that although a subcontractor to Cambridge Analytica is having the finger pointed at the moment, there could be plenty of other examples of similar albeit less voluminous accesses from other app developers.

Of course, Cambridge Analytica took it to a further level. Their website boasts about the 5000 data points on every person. Here's today's screen shot from their site:

Although it's not quite as obvious as the teaser they inserted onto their website crowing after Trump's victory.

Check their site today and there is still a slew of PR from around the time of Trump's victory. Although, I can't help wondering if some of these stories may melt away a bit like the protonmail.com emails which can be set to self destruct after a user-specified interval. Who wouldn't have a Swiss crypto email system for those special moments?

I checked the Trump campaign payments to Cambridge Analytica by using the Federal Elections Commission records of the Trump campaign. Just shy of $6m dollars paid from Trump's people to CA, a drop in the ocean of his $348m campaign total. I also noticed around $4m of payments back to entities featuring the name Trump.

So when the currently suspended Mr Nix from Cambridge Analytica was interviewed last year by the FT about the Trump victory he commented that CA worked on 50 Republican campaigns in 2016. Then there's the Jarad Kushner commissioned work with his Trump San Antonio data science team. Nix has gone on to say that his organisation uses data to identify flippable voters and where to target voters to stay at home. Behavioural micro targeting. Just like that done by Strategic Communication Laboratories which is the parent company of CA, although their work has previously been within developing countries.

A not altogether legal aspect of this during an election is that it uses manual curation of the messaging streams, including suppression and injection. The Channel 4 television investigation illustrated that CA routinely uses third parties to insulate their actions. These seem to be both upstream (towards the data) midstream (during acting of influence strategies) and downstream (to insulate the client/candidate).

So we know about some of the upstream activity, but I wonder where CA would get the people to action the influence strategy itself? All those microtargeted adverts (often on Facebook) must have originated somewhere? Surely not the same place as the ones use in Kenya/Mexico/Italy?

Oh yes, and the same FT source mentions that the UK Brexit Leave campaign also used Cambridge Analytica. Oops.

into the woods around Moscow

The media news cycle is gradually shifting around to Porton Down and the analysis of the Salisbury nerve agent. These kind of things all used to be hush-hush, but nowadays even the FSB flaunts its agents. An old Moscow cliche used to be about the use of black Mercedes SUVs by senior Russians (oligarchs and the like).

Last July, FSB (aka KGB) agents took to the streets in a fleet of black SUVs to celebrate their graduation. At one level it could be considered a serious breach of security, or on another level simply a 'don't mess with us' warning to the general populace.

The fleet of expensive Mercedes G-Wagens flaunted their way around central Moscow.

The drivers and passengers noisily drank champagne on the streets. A kind of mob of low-level agents taunting anyone else to 'bring it on'. Kinda where Putin started, actually, although then it was all a lot more clandestine.

Well, with this new found lack of security, I thought I'd take a quick peer around the FSB/SVR offices. Maybe find a chemical lab from which the revised Department Department 12 of Directorate S (Special Operations) could operate. This isn't a unit for mass manufacture of nerve agent, but a more specialised and smaller facility, perhaps close to the spying system's main headquarters?

Looking up FSB would be a bit obvious, but less so to look for the SVR (Sluzhba vneshney razvedki). That's the Foreign Intelligence Service of the Russian Federation /Слу́жба вне́шней разве́дки, or SVR RF / СВР РФ.

It's not too difficult to find, although its co-ordinates on a geo-search are a little bit off. I wonder why?

It's actually to the south west of Moscow, but still close to the main ring road. This is where the offshore espionage people report.

Look around to see the ever expanding size of the campus, conveniently situated in the woods, but highly visible from the nearby suburb of Yasenevo.

So maybe a tiptoe towards the main entrance? Oops, what's that red flashing light? And those sirens?

anything hiding in the mechanical turk?

I see facebook may be about to receive a comeuppance as a result of the way its users had data processed by a Cambridge Analytica subcontractor.

My take is that a pivotal point seems to be the difference between academic and commercial research. If GSR/Global Science Research asked for data to further 'academic research' it appears unconstrained in ways that no commercial entity would be allowed.

The separate compartmentalising of the main players is another interesting facet. If everyone becomes firewalled subcontractors it is far easier to issue denials, "Not us, guv."

Although, come to think of it, the immediate issue of denials seems to be a first response to everything in these spin managed times.

I've never liked facebook. Zuckerberg's first version of face mash was a sophomore project to visually compare on-campus women. He was almost expelled for that, with privacy being one of the citations. Maybe that early disregard for privacy has persisted? You can tell I'm one of the people that think of Facebook as abusive by design right from its throw sheep and poke days.

One of facebook's recent patents is about 'socioeconomic group classification based on user features' - fundamentally another way to profile users so that they receive the right advertising. The basics are not new but there's a scrabble now to be one of the main providers.

Throw Breitbart, Steve Bannon, Robert Mercer/Renaissance Technologies hedge fund/Cambridge Analytica into the mix and the ability to run informational dominant psychological operations (psyops) starts to magnify.

That's the premise of at least part of the electoral influence. Psychographic messaging, derived from an analysis millions of facebook users. Plonking messages most likely to influence in front of voters. Politics downstream from culture.

Of course the technique is not legal, but everyone in the chain has for many months denied any part in it.

The Global Science Research data harvesting via a paid user personality test was cunning. Ask each user if it will allow the user's friends to be used to improve the data collection quality.

Thus grab data from an average of 160 friends per paid respondent capturing 50 million profiles. And maybe use some inexpensive manual help to massage the data?

But of course everyone is denying any part in it.

There's probably insufficient data.

mining spotify playlists

I've been having some fun with Spotify playlists.

The little utility I've been trying is called the playlist miner. It crowdsources a playlist from the results of those curated by others.

Simply type in a search word that others will be likely to have used in playlists and wait a few seconds for all the relevant playlists to arrive in a list.

Then ask the Playlist Miner to curate a list from all the lists, with, say, 100 tracks in it. It'll skim through the found lists looking for top hits and then pipe them into a new personal list. The new list can be saved directly as a personal list on Spotify.

It's good fun to see what shows up, with a choice of top tunes or a more individualistic selection. Just for fun, I tried UK top tunes too. Here's my derived Saturday's top of the pops, which inevitably features some 'lead and lag' compared with the official chart.