"Thread on climate change & Irish agri lobbyists"
'The massive levy income raised on beef & dairy gives the IFA a financial incentive to promote beef & dairy expansion and a disincentive to support any fundamental changes to Ireland’s agricultural model, regardless the public interest.'
(tags: dairy beef ireland farming climate-change climate lobbying government)
Year: 2018
slides from "Distributed Log-Processing Design Workshop", SRECon Americas 2018
Fantastic presentation discussing the kinds of design criteria used when architecting a large-scale data processing and storage service. Interesting to see some Google terminology, e.g. "dimensioning" -- ballparking the expected scalability numbers, bandwidth, qps, and limits.
(tags: distributed-systems coding design architecture google photon logs log-storage slides srecon)
Zstandard: How Facebook increased compression speed - Facebook Code
very cool; particularly the high level of support for external-dictionary compression
(tags: facebook compression zstd zstandard dictionary-compression)
The Holiday Drink of 2018: Cognac Punch
Looks tasty, albeit pricey and strong:
London Punch House Punch By David Wondrich Ingredients: 4 Lemons 6 oz (3/4 cup) White sugar 20 oz Hennessy Privilege VSOP Cognac 6 oz Jamaican rum 1 quart (4 cups) Cold water Glass: Punch cup Garnish: Freshly grated nutmeg Directions: The day before you serve the punch, fill a quart container with water and put it in the freezer. Peel 4 lemons in long spirals and put the peels into a mason jar with 6 oz (3/4 cup) of white sugar. Seal the jar, shake it and let sit overnight. Two hours before you serve the punch, unseal the mason jar, add 6 oz (3/4) cup fresh-squeezed, strained lemon juice, reseal and shake until all the sugar has dissolved. Refrigerate. To assemble the punch, unmold the ice block and place it in a 1-gallon punch bowl. Shake the contents of the mason jar and pour it into the punch bowl unstrained, peels and all. Add 20 oz (2-and-a-half cups) Hennessy Privilege VSOP Cognac and 6 oz (3/4 cup) Jamaican rum. Stir. Add 1 quart (4 cups) cold water. Stir again and grate nutmeg on top. Using a punch ladle, drape a few ends of the spiral lemon peels over the rim of the bowl. Grate nutmeg over the top.
-
at PayPal (via Carlos Baquero)
(tags: via:xmal crdts distributed-systems distcomp prod coding data-structures)
-
A fully automated background-removal tool. Nicely done
(tags: images editing tools background graphics)
Google used a Baidu front-end to scrape user searches without consent
The engineers used the data they pulled from [acquired Baidu front-end site] 265.com to learn about the kinds of things that people located in mainland China routinely search for in Mandarin. This helped them to build a prototype of Dragonfly. The engineers used the sample queries from 265.com, for instance, to review lists of websites Chinese people would see if they typed the same word or phrase into Google. They then used a tool they called “BeaconTower” to check whether any websites in the Google search results would be blocked by China’s internet censorship system, known as the Great Firewall. Through this process, the engineers compiled a list of thousands of banned websites, which they integrated into the Dragonfly search platform so that it would purge links to websites prohibited in China, such as those of the online encyclopedia Wikipedia and British news broadcaster BBC. Under normal company protocol, analysis of people’s search queries is subject to tight constraints and should be reviewed by the company’s privacy staff, whose job is to safeguard user rights. But the privacy team only found out about the 265.com data access after The Intercept revealed it, and were “really pissed,” according to one Google source.
(tags: china search tech google privacy baidu interception censorship great-firewall dragonfly)
awslabs/amazon-kinesis-scaling-utils
The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to Shards when using this API, as it is done automatically. You can also deploy the Web Archive to a Java Application Server, and allow Scaling Utils to automatically manage the number of Shards in the Stream based on the observed PUT or GET rate of the stream.
The “Bart” — sudden hundreds-of-Bitcoin pumps or dumps, to burn the margin traders
Finance journalists need to stop treating crypto as an efficient market that responds to concerns. It’s a thinly-traded unregulated playground for whales, out to wreck the margin traders. A $400 dip in fifteen minutes is not a “market signal” — it’s a deliberate dump to manipulate the price. Though there’s still downward pressure on the price — all the suckers from the bubble have gone home, so they’re not buying … but the miners still have to sell coins for actual money to pay for their electricity. And even more so now that the price of mining one bitcoin is at — or above — what you could get for selling that bitcoin. So one minute you’ll see a sudden $100 increase in the price that cost 130 BTC of dollars — and those are actual dollars going in — followed the next minute by a matching $100 drop that came from selling only 30 BTC. It’s much easier to drop the price than raise it.
(tags: investing bitcoin via:harikunzru cryptocurrency pump-and-dump barts finance margin-traders currencies fraud)
GDPR Subject Access Request helper for Dublin Bus vs bike incidents
'A new tool has been created to assist people who want to request video footage of incidents involving Dublin Bus under GDPR rules.'
(tags: dublin-bus bus bike cycling dublin cameras gdpr sars)
8 Myths of Abortion in Ireland
from the Abortion Rights Campaign's "8 Days - 8 Reasons to Repeal the 8th" myth-busting series in 2014.
(tags: arc abortion ireland politics mythbusters repealthe8th)
Notebookcheck's Top 10 Tablets under 250 Euros
a decent list of low-end tablets, given the season
A primer on privacy as "contextual integrity"
A primer on privacy as "contextual integrity" and why privacy notices on mobile platforms (both Android and iOS) are insufficient for attaining informed consent. If your doctor asked for permission to collect your medical history, you would probably say yes. However, if that doctor asked to collect your medical history to give to marketers for advertising purposes, you would probably decline. The difference is, in the first case, you're making assumptions about how the data will be used based on who is making the request. Knowing just the type of data requested and the requester are insufficient to make an informed decision: people also consider the purpose and other constraints (e.g., will data be resold, stored securely, etc.), which are equally important factors.
(via Karlin)(tags: privacy context understanding mobile data-protection permission opt-in)
-
Uber’s Fast, Reliable Docker Image Builder for Apache Mesos and Kubernetes.
we built our own image building tool, Makisu, a solution that allows for more flexible, faster container image building at scale. Specifically, Makisu: requires no elevated privileges, making the build process portable. uses a distributed layer cache to improve performance across a build cluster. provides flexible layer generation, preventing unnecessary files in images. is Docker-compatible, supporting multi-stage builds and common build commands.
(tags: makisu docker containers ops build mesos kubernetes building)
Billionaires Are the Leading Cause of Climate Change
That's largely because there is no "free market" incentive to prevent disaster. An economic environment where a company is only considered viable if it's constantly expanding and increasing its production can't be expected to pump its own brakes over something as trivial as pending global catastrophe. Instead, market logic dictates that rather than take the financial hit that comes with cutting profits, it's more reasonable to find a way to make money off the boiling ocean. Nothing illustrates this phenomenon better than the burgeoning climate-change investment industry. According to Bloomberg, investors are looking to make money off of everything from revamped food production to hotels for people fleeing increasingly hurricane-ravaged areas. A top JP Morgan Asset investment strategist advised clients that sea-level rise was so inevitable that there was likely a lot of opportunity for investing in sea-wall construction.
(tags: capitalism environment politics future climate-change doom)
Irish agricultural CO2 emissions actually INCREASED by 2.9% last year
Irish EPA: agriculture greenhouse gas emissions increased by 2.9% in 2017 “The most significant drivers are higher dairy cow numbers (+3.1%) which reflects national plans to expand milk production”
Feck's sake.(tags: epa ireland co2 greenhouse-gases emissions green farming agriculture)
"Bring home the bacon" debate is a case study in how stupid we've all become
Well said, that Carl Kinsella.
How are we supposed to focus on the things that matter when media organisations refuse to? Ivan Yates and Matt Cooper ran a segment on whether or not we've reached political correctness. Niall Boylan had a discussion about whether or not it's okay to ban phrases that nobody really wants to ban [as PETA has suggested]. As a matter of pure coincidence, other reports from outlets like the Daily Mail and Today FM reported that the HSE was going to ban its employees from using phrases like "love," "pet" or "dear." That wasn't true either. Again, it was one line in a huge report that asked the question as to whether or not it was the best course of action to use such terms. It wasn't mentioned again. Unlike phrases about meat, this actually matters. This is the kind of thing that could actually change how people are treated in hospital. But again, it wasn't true. The public – which has lost its capacity to verify what is true and what is not — was being lied to by the media. That's how it works now.
(tags: media clickbait fake-news news today-fm daily-mail hse niall-boylan peta controversy political-correctness ivan-yates matt-cooper)
Rudy Giuliani doesn't understand how links work
As waxy noted: 'this might be funny if he wasn't Trump's cybersecurity advisor'.
Twitter allowed someone to invade my text with a disgusting anti-President message. The same thing-period no space-occurred later and it didn’t happen. Don’t tell me they are not committed cardcarrying anti-Trumpers. Time Magazine also may fit that description. FAIRNESS PLEASE
Giuliani composed a tweet with no spaces after full stops, and a broken regexp at Twitter auto-linkified "G-20.In". An internet prankster registered this domain and Giuliani lost his shit in a spectacular display of incompetence. The best bit? Here's a thread with the original devs: https://twitter.com/hoverbird/status/1070142045140877312 -- 'Hey @tw and @bcherry, remember all the debates we had about the linkifying regex around edge cases like this?' (via Waxy and pretty much everyone on twitter)(tags: edge-cases bugs twitter regexps regular-expressions links urls us-politics trump rudy-giuliani security funny)
3D models by DH_Age Sheela-na-Gig3D Project (@DH_Age) - Sketchfab
These are fantastic -- 3D scans of Sheela-na-Gig carvings around Ireland from 3D Sheela, an Irish based research initiative 'focusing on the digital documentation and analysis of Ireland's Sheela-na-Gig catalogue' (NSFW)
(tags: 3d sheela-na-gigs history carving nsfw models photogrammetry)
Chester Beatty Digital Collections
'Explore online access to our remarkable treasures, through this searchable database of digitised artworks and manuscripts', from the Chester Beatty museum's collection. Licensing isn't fully open though -- 'Images and PDF's are provided for personal research and scholarship.'
(tags: chester-beatty museums history archaeology artifacts art manuscripts)
Convert an RSS feed to ActivityPub
for autoposting to Mastodon or similar. Via Nelson
(tags: via:nelson mastodon rss blogging scripts)
A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1) - AWS re:…
Marc Brooker on Lambda internals
(tags: lambda aws marc-brooker ops slides)
Nice heatmap visualisation of mortality ratios between men and women
'Age and period specific mortality ratios of females and males (a "Lexis-surface" in demographers parlance)' (via apenwarr)
(tags: via:apenwarr mortality heatmaps dataviz visualisation colouring lexis-surfaces)
House Democrats Sent A New Letter To Jeff Bezos About Amazon’s Facial Recognition Tool
The House Democrats’ questions focus largely on possible embedded bias in Amazon Rekognition, including how the tool’s accuracy breaks down by race, gender, ethnicity, and age. Also of particular concern is whether Amazon will build privacy protections into its facial recognition system and how it will ensure it is not abused for secret government surveillance. [....] Meanwhile, Jeff Bezos has yet to address mounting criticism of Amazon’s Rekognition technology by Amazon employees, shareholders, and civil rights groups. In November, Amazon executives defended the company’s controversial facial recognition technology at an all-hands staff meeting after employees raised civil rights concerns about the tech’s potential misuse. “It’s hard to trust that harm and abuse can be prevented if it is only post-mortem and through the Terms of Service,” an Amazon employee who requested anonymity told BuzzFeed News at the time.
(tags: rekognition aws privacy data-protection surveillance amazon us-politics civil-rights)
Google Tried to Patent My Work After a Job Interview
I looked up the patent application and luckily, this time the patent application was still being reviewed by the patent examiner. It had not issued! The provisional was filed August 29, 2014, months after my first interview and visit back in March 2014. Two of the inventors listed were the same people who had interviewed me.
This is frankly appalling behaviour from Google -- total abuse of the patent system. If Joi Ito hadn't been around to mediate this patent probably would have issued and this researcher's life's work stolen from her through IP dirty tricks. (Also, patents need to die)(tags: patents software-patents google dirty-tricks interviewing ip mit medialab paper jie-qi)
Crowdfunding Backer Patented My Project
I had thought thought all along that if we published everything openly, it wouldn’t be possible for someone else to patent stuff that’s already all over the web. But I was wrong. Despite tons of prior art out on the web, in academic research papers and even for sale that are LED stickers, the patent examiner missed it and deemed the LED sticker patent “new” and “non-obvious.” How could that happen? The sad truth is that patents are approved all that time that probably shouldn’t be. [...] Can’t you invalidate the patent? Unfortunately, once a patent gets issued things get much more complicated and expensive. The cheapest option would be for us to go to the USPTO with our prior art list and invalidate the patent though a process called an inter partes review (IPR). But such a process typically costs between $300,000 and $600,000 to file due to legal fees. In fact, it’s much more than the cost of getting the patent in the first place! So for now, we’ve decided not to go down this route.
The US patent system is broken. This is appalling(tags: patents led-stickers uspto prior-art invention crowdfunding)
PRDD - Performance-Review Driven Development
'If the way to get promoted is to launch a shiny new product, then your most senior people will be the best at finding shiny new products to launch, even if that's not the right technical decision to make.' (from a newsy thread about Twitter's latest messaging system switch)
(tags: newsy messaging infrastructure twitter kafka pubsub ops architecture prdd performance-reviews)
Presto Performance for Ad Hoc Workloads on AWS Instance Types
good benchmark/review of instance types from Qubole
(tags: qubole presto performance benchmarks ops aws instances ec2)
-
Enter an image URL and it'll generate an animated GIF of the party parrot version
(tags: party-parrot gifs funny slack emojis)
event-stream vulnerability explained - Zach Schneider
This was an incredibly clever attack, very reminiscent of this blog post from January about how a similar attack might work. The attacker covered their tracks well — the code and commit log on GitHub all tell an innocuous and fairly common story (a new maintainer joins a project, adds a feature, and then tweaks the implementation of their feature a bit). Other than the warning signs about flatmap-stream (new package, no contributors or download activity), the attack was virtually undetectable. And indeed, it wasn’t discovered for over two months — it was only found because the attacker made a tiny mistake and used the deprecated crypto.createDecipher rather than crypto.createDecipheriv, which raised a suspicious deprecation warning in another library that consumes event-stream. Unfortunately, this genre of attack isn’t going away anytime soon. JavaScript is the most popular language right now and it’s not really close, meaning it will continue to be an attractive target for hackers. JavaScript also has relatively few standard-library convenience features compared to other languages, which encourages developers to import them from npm packages instead — this, along with other cultural factors, means that JavaScript projects tend to have massive dependency trees.
(via Nelson)(tags: npm malware bitcoin security javascript event-stream flatmap-stream hacks)
Leeroy Jenkins was taking the piss
I had no idea!
"We didn’t think anyone would believe it was real, we thought it was so obviously satire."
(tags: leeroy-jenkins warcraft gaming memes satire videos at-least-i-have-chicken)
-
A way to handle immutable blockchains and GDPR: "have an encryption key for each user (stored outside of this ledger) and encrypt all PII with that key. Throw away the key if the user wants you to delete their data."
(tags: pii gdpr privacy data-protection crypto cryptoshredding deletion coding)
flatmap-stream NPM package backdoor incident
Good twitter thread with background on the incident. 2,000,000 downloads per week, used by many other core libs. It appears the attacker persuaded the (overloaded) legit maintainer to hand over ownership then backdoored the package in order to attack copay-dash, a cryptocurrency wallet app.
(tags: cryptocurrency npm packages open-source twitter flatmap-stream packaging security backdoors)
Antoin O Lachtnain on Twitter regarding GDPR and DNA kits
'It provides legal protections. But the problem is that those protections may not be practically effective. The other problem is the effect that you, as a consenting adult may have on other people who are related to you but who haven't consented.' -- useful thread
(tags: gdpr privacy data-protection dna)
-
Declarative Airflow Workflows in YAML, from Etsy
-
The 2.0 release of Linkerd brings two very significant changes. First, we’ve completely rewritten Linkerd to be orders of magnitude faster and smaller than Linkerd 1.x. Linkerd 2.0’s data plane is comprised of ultralight Rust proxies which consume around 10mb of RSS and have a p99 latency of <1ms. Linkerd’s minimalist control plane (written in Go) is similarly designed for speed and low resource footprint. Second, with the 2.0 release, Linkerd moves beyond the service mesh model to be something not more, but less: Linkerd 2.0 at its core is a service sidecar, running on a single service without requiring cluster-wide installation. This means that if you’re a developer or service owner who doesn’t have access to the whole Kubernetes cluster, you can run Linkerd on your service and get: Instant Grafana dashboards of your service’s success rates, latencies, and throughput; A topology graph of incoming and outgoing dependencies; A live view of requests being made to your service; Improved, latency-aware load balancing; … and much more.
(tags: linkerd mesh networking services architecture sidecars)
-
the act of having a small portion of your cremated remains fired in a Brickof Mu. MuMufied is what you will be after the act of MuMufication has been carried out. What you get in the here and now is a Brick of Mu and a signed and stamped Certificate of MuMufication. What you get after you die is 23 grams of yours cremated remains fired in your Brick of Mu, which will then be laid to rest on The People’s Pyramid come the following Toxteth Day of the Dead on 23rd of November.
(tags: klf mu mumufication 23 eris discordianism religion death toxteth liverpool cremation pyramids)
Introducing Predictive Scaling for Amazon EC2 in AWS Auto Scaling
Predictive Scaling predicts future traffic based on daily and weekly trends, including regularly-occurring spikes, and provisions the right number of EC2 instances in advance of anticipated changes. Provisioning the capacity just in time for an impending load change makes Auto Scaling faster than ever before. Predictive Scaling’s machine learning algorithms detect changes in daily and weekly patterns, automatically adjusting their forecasts. This removes the need for manual adjustment of Auto Scaling parameters over time, making Auto Scaling simpler to configure and consume. Auto Scaling enhanced with Predictive Scaling delivers faster, simpler, and more accurate capacity provisioning to our customers.
Fantastic! More heavy lifting taken care of.(tags: aws amazon scaling autoscaling predictive-scaling ml ec2 asg)
-
Artificial intelligence in its current state is unfair, easily susceptible to attacks and notoriously difficult to control. Nevertheless, more and more concerning uses of AI technology are appearing in the wild. This list aims to track all of them. We hope that Awful AI can be a platform to spur discussion for the development of possible contestational technology (to fight back!).
(tags: ai algorithms ethics technology machine-learning)
-
Robert Graham from ErrataSec on QUIC aka HTTP/3: 'Google (pbuh) has both the most popular web browser (Chrome) and the two most popular websites (#1 Google.com #2 Youtube.com). Therefore, they are in control of future web protocol development.' Faster connection setup and latency; better bandwidth negotiation when using multiplexing; user-mode stacks by building on UDP and using recvmmsg(); and better mobile support for roaming IPs.
Traditional Chinese medicine origins: Mao invented it but didn’t believe in it
Mikulski and the rest of the Senate may be surprised to learn that they were repeating 60-year-old justifications of Chinese medicine put forward by Chairman Mao. Unlike Mikulski, however, Mao was under no illusion that Chinese medicine—a key component of naturopathic education—actually worked. In The Private Life of Chairman Mao, Li Zhisui, one of Mao’s personal physicians, recounts a conversation they had on the subject. Trained as an M.D. in Western medicine, Li admitted to being baffled by ancient Chinese medical books, especially their theories relating to the five elements. It turns out his employer also found them implausible.
via Dr. Jen Gunter
Java's ByteBuffer native memory "leak"
Well this is suboptimal:
The Java NIO APIs use ByteBuffers as the source and destination of I/O calls, and come in two flavours. Heap ByteBuffers wrap a byte[] array, allocated in the garbage collected Java heap. Direct ByteBuffers wrap memory allocated outside the Java heap using malloc. Only "native" memory can be passed to operating system calls, so it won't be moved by the garbage collector. This means that when you use a heap ByteBuffer for I/O, it is copied into a temporary direct ByteBuffer. The JDK caches one temporary buffer per thread, without any memory limits. As a result, if you call I/O methods with large heap ByteBuffers from multiple threads, your process can use a huge amount of additional native memory, which looks like a native memory leak. This can cause your process to unexpectedly run into memory limits and get killed.
(tags: jvm performance java memory leaks bytebuffers netty threads coding bugs)
The Time Our Provider Screwed Us
Good talk (with transcript) from Paul Biggar about what happened when CircleCI had a massive security incident, and how Jesse Robbins helped them do incident response correctly. 'On the left, Jesse pointed out that we needed an incident commander. That’s me, Paul. And this is very good, because I was a big proponent, I think lots of were around the 2013 mark, of flat organizational structures, and so I hadn’t really got a handle of this whole being in charge thing. The fact that someone else came in and said, “No, no, no, you are in charge”: extremely useful. And he also laid out the order of our priorities. Number one priority; safety of customers. Number two priority: communicate with customers. Number three priority: recovery of service. I think a reasonable person could have put those in a different order, especially under the pressure and time constraints of the potential company-ending situation. So I was very happy to have those in order. If this is ever going to happen to you, I’d memorize them, maybe put it on an index card in your pocket, in case this ever happens. The last thing he said is to make sure that we log everything, that we go slow, and that we code review and communicate. His point there is that if we’re going to bring our site back up, if we’re going to do all the things that we need to do in order to save our business and do the right thing for our customers and all that, we can’t be making quick, bad decisions. You can’t just upload whatever code is on your computer now, because I have to do this now, I have to fix it. So we set up a Slack channel … This was pre-Slack; it was a HipChat channel, where all of our communications went. Every single communication that we had about this went in that chatroom. Which came in extremely useful the next day, when I had to write a blog post that detailed exactly what had happened and all the steps that we did to fix it and remediate this, and I had an exact time stamps of all the things that had happened.'
(tags: incidents incident-response paul-biggar circleci security communication outages)
Deep learning can "discover" new knowledge from scans/images
Amazing paper:
Here, we show that deep learning can extract new knowledge from retinal fundus images. Using deep-learning models trained on data from 284,335 patients and validated on two independent datasets of 12,026 and 999 patients, we predicted cardiovascular risk factors not previously thought to be present or quantifiable in retinal images, such as age (mean absolute error within 3.26 years), gender (area under the receiver operating characteristic curve (AUC)?=?0.97), smoking status (AUC?=?0.71), systolic blood pressure (mean absolute error within 11.23?mmHg) and major adverse cardiac events (AUC?=?0.70). We also show that the trained deep-learning models used anatomical features, such as the optic disc or blood vessels, to generate each prediction.
(tags: deep-learning data analysis ml machine-learning health medicine papers)
-
'a next-generation, no-compromise automation system'.
Uses: Web-scale configuration management of all Linux/Unix systems; Application deployment; Immutable systems build definition; Maintaining stateful services such as database and messaging platforms; Automating one-off tasks & processes; Deployment and management of the undercloud. Features: Python 3 DSL; Declarative resource model with imperative capabilities; Type / Provider plugin seperation; Implicit ordering (with handler notification); Formalized “Plan” vs “Apply” evaluation stages; Early validation prior to runtime; Programatically scoped variables; Strong object-orientation
(tags: opsmop ops configuration-management deployment build)
-
Later JDK versions have made it far easier to run a JVM application in a Linux container. The memory support means that if you relied on JVM ergonomics before than you can do the same inside a container where as previously you had to override all memory related settings. The CPU support for containers needs to be carefully evaluated for your application and environment. If you’ve previously set low cpu_shares in environments like Kubernetes to increase utilisation while relying on using up unused cycles then you might get a shock.
(tags: jvm docker kubernetes linux containers ops)
This Week’s Giza Pyramid Discovery Was Already Built Into Assassin’s Creed Origins
As a kid, I was Egypt-obsessed -- this game is hitting the spot
(tags: assassins-creed egypt history pyramids architecture)
Tuning Spark Back Pressure by Simulation
Interesting, Spark uses a PID controller algorithm to manage backpressure:
Spark back pressure, which can be enabled by setting spark.streaming.backpressure.enabled=true, will dynamically resize batches so as to avoid queue build up. It is implemented using a Proportional Integral Derivative (PID) algorithm. This algorithm has some interesting properties, including the lack of guarantee of a stable fixed point. This can manifest itself not just in transient overshoot, but in a batch size oscillating around a (potentially optimal) constant throughput. The overshoot incurs latency; the undershoot costs throughput. Catastrophic overshoot leading to OOM is possible in degenerate circumstances (you need to choose the parameters quite deviously to cause this to happen). Having witnessed undershoot and slow recovery in production streaming jobs, I decided to investigate further by testing the algorithm with a simulator.
(tags: backpressure streaming queueing pid-controllers algorithms congestion-control)
New – EC2 Auto Scaling Groups With Multiple Instance Types & Purchase Options | AWS News Blog
Basically getting EC2 Fleet's featureset into ASGs, good news
(tags: ec2 fleet asg ops architecture cost-control)
SpamAssassin is back [LWN.net]
The SpamAssassin 3.4.2 release was the first from that project in well over three years. At the 2018 Open Source Summit Europe, Giovanni Bechis talked about that release and those that will be coming in the near future. It would seem that, after an extended period of quiet, the SpamAssassin project is back and has rededicated itself to the task of keeping junk out of our inboxes.
This is good to see! Also, newsy thread: https://news.ycombinator.com/item?id=18458212(tags: spamassassin open-source oss anti-spam)
Google 'betrays patient trust' with DeepMind Health move | Technology | The Guardian
Now that Streams is a Google product itself, that promise appears to have been broken, says privacy researcher Julia Powles: “Making this about semantics is a sleight of hand. DeepMind said it would never connect Streams with Google. The whole Streams app is now a Google product. That is an atrocious breach of trust, for an already beleaguered product.” A DeepMind spokesperson emphasised that the core of the promise remains intact: “All patient data remains under our partners’ strict control, and all decisions about its use lie with them. This data remains subject to strict audit and access controls and its processing remains subject to both our contracts and data protection legislation. The move to Google does not affect this.”
(tags: google deepmind health nhs data-protection privacy healthcare)
Jeff Bezos is wrong, tech workers are not bullies
I decided to leave my job as a staff engineer at Google because of Project Maven, and because I believe that the artificial intelligence ethical guidelines they published afterwards were not strict enough: they allowed surveillance within “internationally accepted norms”. I am now joining forces with current and former Google employees who also opposed Maven and the Dragonfly search engine. We do not wish to be complicit in human rights violations and we believe that workers, and the public, deserve a voice. We support employees at Amazon, Microsoft, Salesforce, McKinsey and Deloitte who have similarly stood up to their employers. We also have a right to not contribute to killing. Most workers at Google or Amazon did not join those companies to work on military applications. Both companies are international employers with engineering offices across the world, and many of their workers are neither US citizens nor residents. I worked as an engineer in Google's European headquarters in Dublin, Ireland. To me, the US military is not our military (as Google Cloud chief executive Diane Greene referred to it in a blog post), nor is it a force we should automatically support as a matter of patriotism. As an engineer, I believe it is my responsibility to speak up for human rights and accountable decision making. As an industry, we in technology cannot compromise our principles or allow ourselves to be bullied by billionaires who stand to be enriched by our silence.
(tags: project-maven dragonfly google amazon surveillance us-politics politics ai silicon-valley ethics work life)
HTTP-over-QUIC to be renamed HTTP/3
Decent newsy comment thread about HTTP/3, QUIC, and how the modern internet treats IP protocols
(tags: ip protocols http http3 quic networking internet newsy)
Brits getting into the online-disinfo game
Disinformation and deception have been a part of warfare for thousands of years, but across the world, something new was starting to happen. Information has long been used to support combat operations, but now combat was seen to taking place primarily, sometimes exclusively, through it. From being a tool of warfare, each military began to realise that the struggle with, over and through information was what war itself actually was about. And it wasn’t confined to Russia, China or anyone else. A global informational struggle has broken out. Dozens of countries are already doing it. And these are just the campaigns that we know about.
(tags: disinfo fake-news uk british-army military memes infowar)
Some notes on running new software in production
This is really good -- how to approach new infrastructure/software dependencies in production with reliability and uptime in mind. (via Tony Finch)
(tags: reliability uptime slas kubernetes envoy outages runbooks ops)
Specification gaming examples in AI
A good list of examples where machine learning systems "figure out" how to cheat their fitness function, e.g.:
'Creatures bred for speed grow really tall and generate high velocities by falling over'
(tags: ai funny humor spreadsheets machine-learning ml fitness-functions)
What if the Placebo Effect Isn’t a Trick? - The New York Times
It is not possible to assay levels of COMT directly in a living brain, but there is a snippet of the genome called rs4680 that governs the production of the enzyme, and that varies from one person to another: One variant predicts low levels of COMT, while another predicts high levels. When Hall analyzed the I.B.S. patients’ DNA, she found a distinct trend. Those with the high-COMT variant had the weakest placebo responses, and those with the opposite variant had the strongest. These effects were compounded by the amount of interaction each patient got: For instance, low-COMT, high-interaction patients fared best of all, but the low-COMT subjects who were placed in the no-treatment group did worse than the other genotypes in that group. They were, in other words, more sensitive to the impact of the relationship with the healer. The discovery of this genetic correlation to placebo response set Hall off on a continuing effort to identify the biochemical ensemble she calls the placebome — the term reflecting her belief that it will one day take its place among the other important “-omes” of medical science, from the genome to the microbiome. The rs4680 gene snippet is one of a group that governs the production of COMT, and COMT is one of a number of enzymes that determine levels of catecholamines, a group of brain chemicals that includes dopamine and epinephrine. (Low COMT tends to mean higher levels of dopamine, and vice versa.) Hall points out that the catecholamines are associated with stress, as well as with reward and good feeling, which bolsters the possibility that the placebome plays an important role in illness and health, especially in the chronic, stress-related conditions that are most susceptible to placebo effects.
(tags: placebo comt health healthcare medicine enzymes brain)
Deadlines, lies and videotape: The tale of a gRPC bug
HostedGraphite decided to use gRPC as an internal inter-service protocol and ran into a basic protocol bug -- it does not default to using an application-level keepalive on the TCP channel so can block indefinitely if sending-side buffers fill up. Always use application-level keepalives and don't trust TCP
(tags: tcp protocols keepalive grpc rpc architecture networking)
Sci-Fi Writer Greg Egan and 4chan anon Math Whiz Advance Permutation Problem | Quanta Magazine
On September 16, 2011, an anime fan posted a math question to the online bulletin board 4chan about the cult classic television series 'The Melancholy of Haruhi Suzumiya'. Season one of the show, which involves time travel, had originally aired in non-chronological order, and a re-broadcast and a DVD version had each further rearranged the episodes. Fans were arguing online about the best order to watch the episodes, and the 4chan poster wondered: If viewers wanted to see the series in every possible order, what is the shortest list of episodes they’d have to watch? In less than an hour, an anonymous person offered an answer — not a complete solution, but a lower bound on the number of episodes required. The argument, which covered series with any number of episodes, showed that for the 14-episode first season of Haruhi, viewers would have to watch at least 93,884,313,611 episodes to see all possible orderings. “Please look over [the proof] for any loopholes I might have missed,” the anonymous poster wrote. The proof slipped under the radar of the mathematics community for seven years — apparently only one professional mathematician spotted it at the time, and he didn’t check it carefully. But in a plot twist last month, the Australian science fiction novelist Greg Egan proved a new upper bound on the number of episodes required. Egan’s discovery renewed interest in the problem and drew attention to the lower bound posted anonymously in 2011. Both proofs are now being hailed as significant advances on a puzzle mathematicians have been studying for at least 25 years.
(tags: mathematics internet math greg-egan anime bizarre 4chan superpermutation permutation proofs)
How do you populate your development databases?
Lots of comments pro/anti copying from production
(tags: database data testing system-tests dev)
-
To sum it up: A historically unreliable narrator who works for a conspiracy website tweets out a video in order to show alleged bad behavior on the part of a journalist. The clip goes viral. The White House picks up and disseminates that video and uses it as proof to ban the journalist from reporting at the White House. Outraged journalists decry the White House's use of a video taken from a historically unreliable narrator. Then, users attempt to debunk the video as "actual fake news." Others, unclear if the video is fake, urge caution, suggesting the media may be jumping the gun. An argument breaks out over the intricate technical details of doctoring a clip. The entire ordeal is a near perfect example of a scenario disinformation experts have predicted and warned of, where the very threat of video manipulation can lead to a blurring of reality. "These technological underpinnings [of AI and photoshop, and editing programs lead] to the increasing erosion of trust,” computational propaganda researcher Renee DiResta told BuzzFeed News in early 2018. “It makes it possible to cast aspersions on whether videos — or advocacy for that matter — are real.”
(tags: twitter disinfo disinformation buzzfeed video reality fake-news photoshop)
-
A neat kragen hack:
Report wireless signal strength using audio synthesis. This quick kludge is useful for figuring out where the dead spots in your wireless network coverage are. They’re where the pitch goes high and maybe you start getting clicks from audio buffer underruns. Example audio output can be found at <http://canonical.org/~kragen/sw/wifiscan.ogg>. This is based on a brilliant hack by Seth Schoen, in which he generated a tone controlled by the signal strength indication from his wireless card in order to get a sort of 21st-century software Theremin. This adds some envelope modulation so that it’s useful as a network diagnostic tool rather than a musical instrument. It depends on PulseAudio and the interface to the usual set of Linux commands: pacat, ping, and iwconfig. (I should really just read /proc/net/wireless instead of depending on iwconfig.)
Underground Utility Colour Codes Explained
Underground utility colour codes are used to differentiate and identify underground utilities to protect it from damage during excavation. There are different types of utilities and in order to tell them apart coloured lines, flags or sometimes both are used. They help mark the location and indicate the type of utility that is buried underground.
I had no idea! (via Tony Finch)(tags: utilities power underground excavation digging repair urban)
Meet the Irish master codebreaker you never heard of
In 1943, one of Nazi Germany’s most notorious communication codes was broken by a mild-mannered librarian and family man from Abbeyfeale in west Limerick, Richard Hayes. His day job was director of the National Library of Ireland, but during the Emergency, he secretly led a covert team of cryptanalysts, working feverishly on the infamous “Görtz Cipher” – a fiendish Nazi code that had stumped many of the greatest code-breaking minds at Bletchley Park, the centre of British wartime cryptography. Astonishingly, the feat was accomplished not in one of the huts at Bletchley Park, but in a now derelict building colloquially known as “The Red House” on Montpellier Hill in Dublin. If this wasn’t an amazing enough feat, Hayes also broke a complex microdot enciphering system which had baffled the American OSS, as well an enciphering system used by the dreaded Sicherheitsdienst (or SD), the intelligence section of the SS. The breaking of the latter code was instrumental in the Allied victory at the Battle of the Bulge. Few individuals can be said to have altered the course of the second World War on their own, but Hayes was one such individual – and he did it not with a gun, but with a detailed knowledge of the complex algorithms and mathematical permutations involved in the art of cryptography.
(via Colm)(tags: via:colmmacc crypto codes hermann-gortz wwii dublin ireland richard-hayes cryptanalysis)
Physical spam using cheap Bluetooth beacons spotted in the wild
Buzz Andersen on Twitter: "Crazy thing: my friends who run a high traffic coffee shop just found this thing under their bar. It turns out to be a super cheap Chinese Bluetooth LE beacon.… https://t.co/pecNBCR86u"
-
'We recently migrated SaleMove infrastructure from self-managed Kubernetes clusters running on AWS to using Amazon Elastic Container Service for Kubernetes (EKS). There were many surprises along the way to getting our EKS setup ready for production. This post covers some of these gotchas (others may already be fixed or are not likely to be relevant for a larger crowd) and is meant to be used as a reference when thinking of running EKS in production.'
-
These pervasive exhortations to individual action — in corporate ads, school textbooks, and the campaigns of mainstream environmental groups, especially in the west — seem as natural as the air we breathe. But we could hardly be worse-served. While we busy ourselves greening our personal lives, fossil fuel corporations are rendering these efforts irrelevant. The breakdown of carbon emissions since 1988? A hundred companies alone are responsible for an astonishing 71%. You tinker with those pens or that panel; they go on torching the planet. The freedom of these corporations to pollute – and the fixation on a feeble lifestyle response – is no accident. It is the result of an ideological war, waged over the last 40 years, against the possibility of collective action. Devastatingly successful, it is not too late to reverse it. The political project of neoliberalism, brought to ascendence by Thatcher and Reagan, has pursued two principal objectives. The first has been to dismantle any barriers to the exercise of unaccountable private power. The second had been to erect them to the exercise of any democratic public will. [...] At the very moment when climate change demands an unprecedented collective public response, neoliberal ideology stands in the way. Which is why, if we want to bring down emissions fast, we will need to overcome all of its free-market mantras.
(tags: politics environment neoliberalism future climate-change green)
Block Advertising on your Network with Pi-hole and Raspberry Pi
A good walkthrough of the Pi-Hole network-wide adblocker install and operation
October 21 post-incident analysis | The GitHub Blog
A network outage caused a split-brain scenario, and their failover system allowed writes to occur in both regional databases. Once the outage was repaired it was impossible to reconcile writes in an automated fashion as a result. Embarrassingly, this exact scenario was called out in their previous blog post about their Raft-based failover system at https://githubengineering.com/mysql-high-availability-at-github/ -- "In a data center isolation scenario, and assuming a master is in the isolated DC, apps in that DC are still able to write to the master. This may result in state inconsistency once network is brought back up. We are working to mitigate this split-brain by implementing a reliable STONITH from within the very isolated DC. As before, some time will pass before bringing down the master, and there could be a short period of split-brain. The operational cost of avoiding split-brains altogether is very high." Failover is hard.
(tags: github fail outages failover replication consensus ops)
-
Analyses open source code repos on github, running static code analysis to find "zero-days and other critical bugs".
(tags: security code-review static-code-analysis coding lgtm github)
cool twitter image compression hack
D?v?d ?uc??n?n on Twitter:
Assuming this all works out, the image in this tweet is also a valid ZIP archive, containing a multipart RAR archive, containing the complete works of Shakespeare. This technique also survives twitter's thumbnailer :P
(via JK)(tags: via:johnke cool compression image jpeg twitter)
A Dark Consensus About Screens and Kids Begins to Emerge in Silicon Valley - The New York Times
John Lilly, a Silicon Valley-based venture capitalist with Greylock Partners and the former C.E.O. of Mozilla, said he tries to help his 13-year-old son understand that he is being manipulated by those who built the technology. “I try to tell him somebody wrote code to make you feel this way — I’m trying to help him understand how things are made, the values that are going into things and what people are doing to create that feeling,” Mr. Lilly said. “And he’s like, ‘I just want to spend my 20 bucks to get my Fortnite skins.’”
(tags: kids technology education parenting screentime apps tech phones)
Your Kid’s Apps Are Crammed With Ads - The New York Times
In apps marketed for children 5 and under in the Google Play store, there were pop-up ads with disturbing imagery. There were ads that no child could reasonably be expected to close out of, and which, when triggered, would send a player into more ads. Dancing treasure chests would give young players points for watching video ads, potentially endlessly. The vast majority of ads were not marked at all. Characters in children’s games gently pressured the kids to make purchases, a practice known as host-selling, banned in children’s TV programs in 1974 by the Federal Trade Commission. At other times an onscreen character would cry if the child did not buy something. “The first word that comes to mind is furious,” said Dr. Radesky, an assistant professor of developmental behavioral pediatrics at the University of Michigan Medical School. “I’m a researcher. I want to stay objective. We started this study really just trying to look at distraction. My frustrated response is about all the surprising, potentially deceptive stuff we found.”
brb, installing Pi-Hole.(tags: children kids ads advertising apps android google ftc games iap)
Epic twitter thread from @colmmacc explaining why client certs and mutual-auth TLS are TERRIBAD
Ok. tweet thread time! Too long ago I promised to write a screed explaining how much I hated mutual-auth TLS and why. I got distracted, and I wasn't happy with the writing, so here it is in tweet thread form instead! But basically: Client certs and Mutual-Auth TLS is TERRIBAD. When I say TERRIBAD, I mean that unless you've got the resources of a big security dept and folks who comb threat models for a living, using clients certs and mutual auth probably materially lessens your security. That's NUTS!
(source: https://twitter.com/colmmacc/status/1057017343438540801 )(tags: terribad rants twitter threads tls ssl authentication mtls security)
-
0 authentication on some setup APIs, including 'delete the current wifi network config' -- pretty major lack of security
(tags: auth security fail google google-home)
-
similar to the Google Home hackable APIs, it seems Chromecasts are easily hacked/scripted with no auth
"The first AI portrait in Christie’s" was mostly output from someone else's open-source code
The print was created by Obvious, a trio of 25-year-old French students whose goal is to “explain and democratize” AI through art. Over the past year, they’ve made a series of portraits depicting members of the fictional Belamy family, amplifying their work through attention-grabbing press releases. But insiders say the code used to generate these prints is mostly the work of another artist and programmer: 19-year-old Robbie Barrat, a recent high school graduate who shared his algorithms online via an open-source license. The members of Obvious don’t deny that they borrowed substantially from Barrat’s code, but until recently, they didn’t publicize that fact either. This has created unease for some members of the AI art community, which is open and collaborative and taking its first steps into mainstream attention.[...] Jason Bailey, a digital art blogger who runs the site Artnome, says that what Obvious has done is far from unusual. “It’s almost weekly in digital art that someone takes some open code and tweaks it and sells it,” he tells The Verge. But the prominence of this auction and the fact that Obvious, not Barrat, has received the attendant prestige and attention does complicate the matter. “There’s a lot of stuff you can do that’s legal, but that makes you sort of a jerk,” adds Bailey. “If I was Robbie, I’d be pretty miffed, and Obvious said they owe him a great deal of credit.” Barrat says he holds no grudges at all and is mostly annoyed that the auction might give outsiders the wrong impression about AI art. “I’m more concerned about the fact that actual artists using AI are being deprived of the spotlight,” he says. “It’s a very bad first impression for the field to have.”
(tags: ai art graphics history open-source ownership copyright obvious robbie-barrat digital)
-
'Tries to move K8s Pods from on-demand to spot instances':
K8s Spot rescheduler is a tool that tries to reduce load on a set of Kubernetes nodes. It was designed with the purpose of moving Pods scheduled on AWS on-demand instances to AWS spot instances to allow the on-demand instances to be safely scaled down (By the Cluster Autoscaler). In reality the rescheduler can be used to remove load from any group of nodes onto a different group of nodes. They just need to be labelled appropriately. For example, it could also be used to allow controller nodes to take up slack while new nodes are being scaled up, and then rescheduling those pods when the new capacity becomes available, thus reducing the load on the controllers once again.
(tags: k8s kubernetes aws scaling spot-instances ops)
-
Air quality sensor board for Raspberry Pis, with a good quality self-calibrating NDIR CO2 sensor
(tags: co2 air quality monitoring metrics health home raspberry-pi hardware to-get)
Motorola and iFixit—A Match Made in Mobile
This is awesome.
Motorola is setting an example for major manufacturers to embrace a more open attitude towards repair. If you’re a Motorola customer, you can now either send in your broken device directly to Motorola for repair—or you can fix it yourself with the highest quality parts and tools, plus a free step-by-step guide, all included in our official Motorola OEM Fix Kits.
Excellent Twitter thread from colmmacc on how s2n avoids protocol-state errors
using a linearized set of state transitions, and Cryptol and SAW to perform verification of the TLS state machine
(tags: cryptol saw formal-verification twitter threads colmmacc security s2n)
Remapping the silly double-S key on a Macbook running 10.12 Sierra
the latest hacky workaround for this stupid Apple keyboard layout bullshit
Republicans Are Adopting the Proud Boys
Extreme-right factions of the GOP happily taking on a brownshirt paramilitary gang. This is scary shit
(tags: fascism america politics proud-boys paramilitary republicans gop)
LOLWUT: a piece of art inside a database command - <antirez>
Redis now includes a reference to "Schotter", by Georg Nees, one of the earliest pieces of computer art. Nice one antirez :)
-
great T-shirt -- adding to the shopping list for the next Threadless trip
(tags: threadless to-get tee-shirts thorazos)
Every fantasy map / Boing Boing
Every fantasy map, ever
Lawsuit: "pivoting to video" was a disaster led by Facebook's cooked viewing data / Boing Boing
The company decided to "obfuscate the fact that we screwed up the math" by quietly retiring the erroneous metrics and replacing them with corrected metrics under a new name. For instance, Average Duration of Video Viewed would be replaced with Average Watch Time. [...] In August 2016, Facebook began reaching out privately to select, large advertisers, telling them that Facebook had "recently discovered a discrepancy" in the video ad average view metrics. Facebook pushed that message even as personnel internally emphasized that "we didn't recently discover a discrepancy." (emphasis added).
-
If Bitcoin were to cease trading tomorrow, 0.5% of the world’s electricity demand would simply disappear. This is roughly equivalent to the output of ten coal-fired power plants, emitting 50 million tonnes of CO2 per year – which would cover one year’s worth of the carbon emission cuts required to limit temperature rises this century to 2C. It is not a solution by itself, but it would be a good year’s work. Bitcoin is made from ashes, and if ashes were legal tender, humanity would burn everything in sight and call it progress.
(tags: environment bitcoin ecology future earth cryptocurrencies pow electricity climate-change)
-
Well this is terrifying.
Can civilisation prolong its life until the end of this century? “It depends on what we are prepared to do.” He fears it will be a long time before we take proportionate action to stop climatic calamity. “Standing in the way is capitalism. Can you imagine the global airline industry being dismantled when hundreds of new runways are being built right now all over the world? It’s almost as if we’re deliberately attempting to defy nature. We’re doing the reverse of what we should be doing, with everybody’s silent acquiescence, and nobody’s batting an eyelid.”
(tags: climate capitalism environment future scary mayer-hillman)
Querying OpenStreetMap Buildings with AWS Athena – door2door Engineering
Well this is damn cool:
AWS not only made OpenStreetMap planet data available on S3, but it also made it query-able with Athena. Pretty cool, no? Now, in theory, you can just construct an SQL query, send it to Athena, and then do whatever you want with the results. No more: Updating OSM planet data yourself; it gets updated on AWS whenever OSM publishes it, once a week. Transforming the data into a query-able format; Athena handles that for you. Query/request frequency limits (it’s still AWS though, so other limitations might apply ???? ????) At door2door, we had a pretty straight-forward use-case for this: we needed to get buildings in specific regions based only on where they were, and transform those buildings into GeoJSON that we can attach our data to, and visualize on the front-end on top of our base map.
(tags: athena osm buildings aws geodata mapping maps door2door cool hacks)
Opinion | When Your Boss Is an Algorithm - The New York Times
I have learned that drivers at ride-hailing companies may have the freedom and flexibility of gig economy work, but they are still at the mercy of a boss — an algorithmic boss. Data and algorithms are presented as objective, neutral, even benevolent: Algorithms gave us super-convenient food delivery services and personalized movie recommendations. But Uber and other ride-hailing apps have taken the way Silicon Valley uses algorithms and applied it to work, and that’s not always a good thing.
(tags: algorithms uber gig-economy work)
A Soyuz "ballistic re-entry" which subjected the crew to 21 g
At the time when the safety system initiated separation the spacecraft was already pointed downward toward Earth, which accelerated its descent significantly. Instead of the expected acceleration in such an emergency situation of 15 g (147 m/s²), the cosmonauts experienced up to 21.3 g (209 m/s²).[2] Despite very high overloading, the capsule's parachutes opened properly and slowed the craft to a successful landing after a flight of only 21 minutes.
(tags: spaceflight soyuz accidents history cosmonauts)
How To Survive The Coming Century
New Scientist article from 2009 with a rather terrifying map of the 4-degrees-warmer Earth
(tags: earth new-scientist climate fear)
IPCC 1.5 degrees target requires massive carbon dioxide removal technology efforts
The grimmest prognosis in the draft report is in the details of the effort it would take to actually limit warming to 1.5°C. Countries won’t just have to give up fossil fuels and stop emitting greenhouse gases; they’ll have to pull carbon dioxide straight out of the air. “All pathways that limit global warming to 1.5°C with limited or no overshoot project the use of carbon dioxide removal (CDR),” according to the report. And not just a little, but a lot, upward of 1,000 gigatons of carbon dioxide removed from the atmosphere by the end of the century. This will require machines that scrub carbon dioxide out of the air as well as biofuels coupled with carbon capture and sequestration. These tactics have their own energy demands and environmental drawbacks, and we may not be able to deploy them in time. “CDR deployment of several hundreds of [gigatons of CO2] is subject to multiple feasibility and sustainability constraints,” according to the IPCC report.
(tags: cdr co2 greenhouse-gases climate-change technology ipcc un)
The 100 best restaurants, cafes and places to eat in Ireland
the Irish Times latest foodie list, via Aoife McElwain
(tags: irish-times food cafes eating dublin foodie restaurants)
A Controversial Virus Study Shows Flaws in How Science Is Done - The Atlantic
Absent clearer guidelines, the burden falls on the scientific enterprise to self-regulate—and it isn’t set up to do that well. Academia is intensely competitive, and “the drivers are about getting grants and publications, and not necessarily about being responsible citizens,” says Filippa Lentzos from King’s College London, who studies biological threats. This means that scientists often keep their work to themselves for fear of getting scooped by their peers. Their plans only become widely known once they’ve already been enacted, and the results are ready to be presented or published. This lack of transparency creates an environment where people can almost unilaterally make decisions that could affect the entire world. Take the horsepox study [the main topic of this article]. Evans was a member of a World Health Organization committee that oversees smallpox research, but he only told his colleagues about the experiment after it was completed. He sought approval from biosafety officers at his university, and had discussions with Canadian federal agencies, but it’s unclear if they had enough ethical expertise to fully appreciate the significance of the experiment. “It’s hard not to feel like he opted for agencies that would follow the letter of the law without necessarily understanding what they were approving,” says Kelly Hills, a bioethicist at Rogue Bioethics. She also sees a sense of impulsive recklessness in the interviews that Evans gave earlier this year. Science reported that he did the experiment “in part to end the debate about whether recreating a poxvirus was feasible.” And he told NPR that “someone had to bite the bullet and do this.” To Hills, that sounds like I did it because I could do it. “We don’t accept those arguments from anyone above age 6,” she says.
(tags: the-atlantic science news smallpox horsepox diseases danger risk academia papers publish-or-perish bioethics ethics biology genetics)
Amazon scraps secret AI recruiting tool that showed bias against women | Reuters
Amazon’s computer models were trained to vet applicants by observing patterns in resumes submitted to the company over a 10-year period. Most came from men, a reflection of male dominance across the tech industry. […] Amazon’s system taught itself that male candidates were preferable. It penalized resumes that included the word “women’s,” as in “women’s chess club captain.” And it downgraded graduates of two all-women’s colleges, according to people familiar with the matter.’
nice demo of algorithmic bias right there. Worrying that there are plenty of other places carrying on with the concept though....(tags: algorithmic-bias amazon hiring resumes bias feminism machine-learning ml)
Wild camping spots - Google My Maps
A GMaps version of the list of wild camping spots around Ireland
When It’s Too Late to Stop Fascism, According to Stefan Zweig | The New Yorker
The destruction of a symbolic edifice—a blaze that caused no loss of life—became the pretext for the government to begin terrorizing its own civilian population. That fateful conflagration took place less than thirty days after Hitler became Chancellor. The excruciating power of Zweig’s memoir lies in the pain of looking back and seeing that there was a small window in which it was possible to act, and then discovering how suddenly and irrevocably that window can be slammed shut.
(tags: fascism europe stefan-zweig politics history germany nazis)
What to Look for in Java 8 Code
Great advice from Trisha Gee on J8 features and how to code-review code which uses them
(tags: java8 java code-review coding)
Wild Camping Spots map Ireland & Northern Ireland
looks like a decent map (even if they can't use GMaps)
(tags: wild-camping camping campsites ireland tourism)
archive.org C64 software library
Pretty amazing that these can be credibly emulated in a browser now!
(tags: c=64 history commodore vice web internet-archive gaming games)
Kubernetes: The Surprisingly Affordable Platform for Personal Projects
At the beginning of the year I spent several months deep diving on Kubernetes for a project at work. As an all-inclusive, batteries-included technology for infrastructure management, Kubernetes solves many of the problems you're bound to run into at scale. However popular wisdom would suggest that Kubernetes is an overly complex piece of technology only really suitable for very large clusters of machines; that it carries a large operational burden and that therefore using it for anything less than dozens of machines is overkill. I think that's probably wrong. Kubernetes makes sense for small projects and you can have your own Kubernetes cluster today for as little as $5 a month.
(via Tony Finch)(tags: via:fanf deployment howto kubernetes ops projects hacks clustering)
This is how cyber attackers stole £2.26m from Tesco Bank customers | ZDNet
What a shitshow.
Poor design of Tesco Bank debit cards played a significant role in creating security vulnerabilities that led to thousands of customers having their accounts emptied. One of these involved the PAN numbers -- the 16-digit card number sequence used to identify all debit cards. Tesco Bank inadvertently issued debit cards with sequential PAN numbers. This increased the likelihood that the attackers would find the next PAN number in the sequence. It took 21 hours after the attack began before Tesco Bank's Fraud Strategy Team was informed about the incident. Only after what the FCA describes as a "series of errors" -- including Tesco Bank's Financial Crime Operations Team sending an email to the wrong address, instead of making a phone call as procedure requires -- was the fraud team made aware of the attack. In all that time, nothing had been done to stop the attacks, with fraudulent transactions continuing to siphon money from accounts as the bank received more and more calls from worried customers.
(tags: tesco fail tesco-bank banking pan-numbers debit-cards security fraud uk)
Running high-scale web applications on Amazon EC2 Spot Instances
AppNext's setup looks like quite good practice for a CPU-bound fleet
(tags: appnext spot-instances ec2 scalability aws ops architecture)
Amazon S3 Announces Selective Cross-Region Replication Based on Object Tags
Amazon S3 Cross-Region Replication (CRR) now supports object filtering based on S3 object tags. This allows you to identify individual objects using S3 object tags for automatic replication across AWS Regions for compliance and/or data protection. CRR is an Amazon S3 feature that automatically replicates every object uploaded to an S3 bucket to a destination bucket in a different AWS Region that you choose. S3 object tags are key-value pairs applied to S3 objects that allow you to better organize, secure, and manage your data stored in S3. By using S3 object tags to determine which objects to replicate using CRR, you now have fine grained control to selectively replicate your storage to another AWS Region to backup critical data for compliance and disaster recovery.
Estonia sues Gemalto for 152 mln euros over ID card flaws
Estonia’s Police and Border Guard Board (PPA) said in a statement Gemalto had created private key codes for individual cards, leaving the government IDs vulnerable to external cyber attack, rather than embedding it on the card’s chip as promised. “It turned out that our partner had violated this principle for years, and we see this as a very serious breach of contract,” PPA’s deputy director-general Krista Aas said in the statement.
If true, this is a big problem...(tags: gemalto fail security smartcards estonia chip-cards)
Defcon Voting Village report: Bug in one system could “flip Electoral College” | Ars Technica
ES&S strike again:
Today, six prominent information-security experts who took part in DEF CON's Voting Village in Las Vegas last month issued a report on vulnerabilities they had discovered in voting equipment and related computer systems. One vulnerability they discovered—in a high-speed vote-tabulating system used to count votes for entire counties in 23 states—could allow an attacker to remotely hijack the system over a network and alter the vote count, changing results for large blocks of voters. "Hacking just one of these machines could enable an attacker to flip the Electoral College and determine the outcome of a presidential election," the authors of the report warned. The machine in question, the ES&S M650, is used for counting both regular and absentee ballots. The device from Election Systems & Software of Omaha, Nebraska, is essentially a networked high-speed scanner like those used for scanning standardized-test sheets, usually run on a network at the county clerk's office. Based on the QNX 4.2 operating system—a real-time operating system developed and marketed by BlackBerry, currently up to version 7.0—the M650 uses Iomega Zip drives to move election data to and from a Windows-based management system. It also stores results on a 128-megabyte SanDisk Flash storage device directly mounted on the system board. The results of tabulation are output as printed reports on an attached pin-feed printer. The report authors—Matt Blaze of the University of Pennsylvania, Jake Braun of the University of Chicago, David Jefferson of the Verified Voting Foundation, Harri Hursti and Margaret MacAlpine of Nordic Innovation Labs, and DEF CON founder Jeff Moss—documented dozens of other severe vulnerabilities found in voting systems. They found that four major areas of "grave and undeniable" concern need to be addressed urgently. One of the most critical is the lack of any sort of supply-chain security for voting machines—there is no way to test the machines to see if they are trustworthy or if their components have been modified.
(tags: fail security evoting vote-tabulation us-politics voting-machines)
How Triplebyte solved its office Wi-Fi problems
This is good general wi-fi infrastructure advice for home use too
randomised prefixes in S3 are no longer necessary to improve performance
This S3 request rate performance increase removes any previous guidance to randomize object prefixes to achieve faster performance. That means you can now use logical or sequential naming patterns in S3 object naming without any performance implications.
Having said that, it sounds like they may still help to a degree anyway.(tags: s3 coding architecture aws tips)
Do not fall into Oracle's Java 11 trap
The key part of the terms is as follows: You may not: use the Programs for any data processing or any commercial, production, or internal business purposes other than developing, testing, prototyping, and demonstrating your Application; The trap is as follows: Download Oracle JDK (because that is what you've always done, and it is what the web-search tells you); Use it in production (because you didn't realise the license changed); Get a nasty phone call from Oracle's license enforcement teams demanding lots of money In other words, Oracle can rely on inertia from Java developers to cause them to download the wrong (commercial) release of Java. Unless you read the text/warnings/legalese very carefully you might not even realise Oracle JDK is now commercial, and that you are therefore liable to pay Oracle for Java.
(tags: java licensing openjdk open-source oracle software jdk jre)
-
lots of nice graphs and dataviz around Dublin Bikes usage
Common Cyborg | Jillian Weise | Granta
Fantastic essay:
When I tell people I am a cyborg, they often ask if I have read Donna Haraway’s ‘A Cyborg Manifesto’. Of course I have read it. And I disagree with it. The manifesto, published in 1985, promised a cyberfeminist resistance. The resistance would be networked and coded by women and for women to change the course of history and derange sexism beyond recognition. Technology would un-gender us. Instead, it has been so effective at erasing disabled women that even now, in conversation with many feminists, I am no longer surprised that disability does not figure into their notions of bodies and embodiment. Haraway’s manifesto lays claim to cyborgs (‘we are all cyborgs’) and defines the cyborg unilaterally through metaphor. To Haraway, the cyborg is a matter of fiction, a struggle over life and death, a modern war orgy, a map, a condensed image, a creature without gender. The manifesto coopts cyborg identity while eliminating reference to disabled people on which the notion of the cyborg is premised. Disabled people who use tech to live are cyborgs. Our lives are not metaphors.
(Via Tony Finch)(tags: via:dotat cyborg technology feminism essay disability tech jillian-weise granta)
25 Years of WIRED Predictions: Why the Future Never Arrives
These early views of the sharing economy were accurate depictions of the moment, but poor visions of the future. Within a few short years, many of those Uber drivers would be stuck paying off their cars in sub-minimum-wage jobs with no benefits. What began as an earnest insight about bits and atoms quickly turned into an arbitrage opportunity for venture capitalists eager to undercut large, lucrative markets by skirting regulations. To meet the growth and monetization demands of investors, yesterday’s sharing economy became today’s gig economy.
(tags: advertising future technology futurism predictions wired web2.0 history 1990s 2000s)
Customer Service Data Vulnerability, Intercom [Fixed]
good demo of the danger of unrestricted API keys
(tags: api-keys security intercom fail dropmobility web apis)
Peter Flynn caused the first 404
Now that's a great bit of web trivia :) "[UCC's] first webmaster was the first person to ever break a link on the web, when he moved the location of a webpage on UCC's servers without telling TimBL. Such a change resulted in the need to error-handle such an occurrence, and the 404 was born"
(tags: 404 history http web peter-flynn ucc irish-web trivia)
Credit reference agency Equifax fined for security breach
The ICO fines Equifax £500K, the maximum amount possible under the old Data Protection Act (via Privacy Kit)
(tags: via:privacy-kit ico equifax privacy data-protection uk penalties law)
Muting some magic keywords fixes the Twitter timeline
Apparently, turning off some of the shittier recent features:
Muting suggest_recycled_tweet_inline and suggest_activity_tweet actually has fixed my timeline. It's all chronological and there are barely any "x and y liked" tweets.
(tags: twitter feature-creep muting hacks)
-
TIL! In other words spelling identifiers-like-this, Lisp style
(tags: kebab-case case lisp identifiers coding terminology)
Cindy Sridharan on Twitter: NanoLog by Ousterhout et al.
- just formatting a log typically takes on the order of 1µs! - nanolog achieves high throughput by shifting work out of runtime hot path into compilation + post-execution phases
Basically records symbolic form of logs, and uses a post-processor after the fact to generate readable text.(tags: logging ops coding performance)
Surprisingly Little Evidence for the Accepted Wisdom About Teeth - The New York Times
Turns out there is little evidence for many dental practices:
A systematic review in 2011 concluded that, in adults, toothbrushing with flossing versus toothbrushing alone most likely reduced gingivitis, or inflammation of the gums. But there was really weak evidence that it reduced plaque in the short term. There was no evidence that it reduced cavities. That’s pretty much what we learned recently.
(tags: teeth dentistry dental health medicine statistics science)
Google spent $60 million on building Content ID
That's how much it costs to build a not-particularly-accurate UGC copyright filter:
Google’s new report takes aim at this claim. It asserts that Content ID is a highly effective solution, with over 98 percent of copyright management on YouTube happening through Content ID, and just 2 percent coming from humans filing copyright removal notices. Google also says the music industry opts to monetize more than 95 percent of its copyright claims, meaning they leave the videos up on the service. It claims a whopping half of the music industry's YouTube revenue comes from fan content — covers, remixes, dance versions, etc. — claimed via Content ID. The report also puts a hard figure on how much Google has spent so far on Content ID: $60 million.
(tags: filtering copyright eu article-13 copyfight content-id google web ugc)
-
Very interesting! This paper and the one at https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0126438 discuss the increasing evidence that some kinds of IBS may be caused by post-infection autoimmune activity triggered by a gastroenteritis infection -- this matches the thing which put me on a restricted diet a few years ago.
(tags: digestion ibs medicine health diet fodmap gastroenteritis papers)
-
Five or six years ago, around the time most people seemed to be spending almost all of their time on the internet, I began to notice a particular kind of online phenomenon, one that I did not have a terminology for. I started to call these moments “artefacts”, borrowing a term from photography that describes the machine-created distortions and ghosts that corrupt digital imagery. “An unintended alteration in data” is one definition, but this new kind of “artefact” was expanding beyond sporadic instances and becoming a persistent sub-theme in discourse at large. The result was a type of semiotic collapse, one that first found its fullest expression in the absurdity of the 2016 presidential campaign, when news stories fabricated in Macedonia found a wider reach than The Washington Post. Countermeasures to interference in the coming 2018 congressional election look ineffectual, perhaps deliberately so.
The British Airways Breach: How Magecart Claimed 380,000 Victims
very detailed and pretty fiendish
(tags: analysis security attacks magecart british-airways web javascript)
UIDAI’s Aadhaar Software Hacked, ID Database Compromised, Experts Confirm
The authenticity of the data stored in India's controversial Aadhaar identity database, which contains the biometrics and personal information of over 1 billion Indians, has been compromised by a software patch that disables critical security features of the software used to enrol new Aadhaar users, a three month-long investigation by HuffPost India reveals. The patch—freely available for as little as Rs 2,500 (around $35)— allows unauthorised persons, based anywhere in the world, to generate Aadhaar numbers at will, and is still in widespread use. This has significant implications for national security at a time when the Indian government has sought to make Aadhaar numbers the gold standard for citizen identification, and mandatory for everything from using a mobile phone to accessing a bank account.
(tags: security aadhaar identity india privacy databases data-privacy)
Troy Hunt: The Effectiveness of Publicly Shaming Bad Security
Now I don't know how much of this change was due to my public shaming of their security posture, maybe they were going to get their act together afterward anyway. Who knows. However, what I do know for sure is that I got this DM from someone not long after that post got media attention (reproduced with their permission): Hi Troy, I just want to say thanks for your blog post on the Natwest HTTPS issue you found that the BBC picked up on. I head up the SEO team at a Media agency for a different bank and was hitting my head against a wall trying to communicate this exact thing to them after they too had a non secure public site separate from their online banking. The quote the BBC must have asked from them prompted the change to happen overnight, something their WebDev team assured me would cost hundreds of thousands of pounds and at least a year to implement! I was hitting my head against the desk for 6 months before that so a virtual handshake of thanks from my behalf! Thanks!
(tags: business internet security social-media shame troy-hunt bad-press spin shaming)
Software as Craft: software delivery and open source in a Cloud & Enterprise world
Niall Murphy sends this on:
Microsoft is very pleased to welcome Maggie Pint and Dr. Nicole Forsgren to our new campus, to talk about open source and the deep connections between how software is written, and how successful it is. For those of you who are not aware, Maggie Pint is a software engineering lead in Azure’s Production Infrastructure Engineering (PIE) organization. Maggie’s team works on improving the engineering systems experience for Microsoft’s web-focused developers. She co-ordinates open source and inner source education and execution through Azure PIE. Outside of her day job, Maggie maintains the popular Moment.js JavaScript library, and is the JS Foundation’s delegate to TC39, the standards committee for JavaScript. She is passionate about dogs, coffee, the JavaScript language, and helping others live open source values in their day-to-day work. Dr. Nicole Forsgren is the co-founder and Chief Scientist of the DevOps Research and Assessment joint venture with Jez Humble and Gene Kim, also well-known leaders in the DevOps community. She is best known as a co-author of Accelerate: The Science of Lean Software and DevOps and lead investigator for the largest-scale DevOps studies undertaken to date. She is also member of the ACM Queue editorial board, a research affiliate for a number of universities, and earned her PhD in Management Information Systems from the University of Arizona. This event comprises two public technical talks, with an intended audience of a few hundred software and systems professionals, including technical managers and SREs.
(tags: software coding open-source microsoft maggie-pint nicole-forsgren azure)
gRPC On HTTP/2: Engineering A Robust, High Performance Protocol
Decent writeup on how gRPC uses HTTP/2 efficiently
'The Internet of Garbage' by Sarah Jeong
Sarah Jeong's 2015 book is now free: 'I think The Internet of Garbage still provides a useful framework to begin to talk about our new dystopia, and it continues to be surprisingly relevant in many ways. But I wrote the book with a tone of optimism I did not feel even at the time, hoping that by reaching the well-meaning policy teams across Silicon Valley, I might be able to spark change for the better. Not only did that change never quite solidify, but the coordinated, orchestrated harassment campaigns of Gamergate that I very briefly touch on in Chapter Two have since overtaken our national political and cultural conversations. These twisted knots of lies, deflection, and rage are not just some weird and terrible online garbage. They shadow executive orders, court rulings, even the newly appointed judiciary. They will haunt us for years to come. We are all victims of fraud in the marketplace of ideas. I hope that in the very near future, I will be putting out a second edition of The Internet of Garbage. In that future edition, I hope to grapple with advertising incentives, engagement traps, international propaganda wars, the American crisis in free speech coinciding with the rise of platform power, and search engine optimization as the new paradigm of speech. In the meantime, I am putting out The Internet of Garbage 1.5 as an interim edition. I wish it were more helpful in our present reality. But as imperfect a tool as it is, I figure we all need as much help as we can get. '
(tags: dystopia fake-news internet spam harrassment abuse twitter gamergate politics books free to-read)
-
cOAlition S signals the commitment to implement, by 1 January 2020, the necessary measures to fulfil its main principle: “By 2020 scientific publications that result from research funded by public grants provided by participating national and European research councils and funding bodies, must be published in compliant Open Access Journals or on compliant Open Access Platforms.” The 11 national research funding organisations that form cOAlition S have agreed to implement the 10 principles of Plan S in a coordinated way, together with the European Commission including the ERC. Other research funders from across the world, both public and private, are invited to join cOAlition S.
I am extremely happy to see SFI on this list! (Via Cathal Garvey)(tags: sfi ireland funding science open-access open papers journals via:cathalgarvey)
Mastodon and the challenges of abuse in a federated system
Similar to this thread by CJ Silverio, I’m not thinking about this in terms of whether Wil Wheaton or his detractors were right or wrong. Rather, I’m thinking about how this incident demonstrates that a large-scale harassment attack by motivated actors is not only possible in the fediverse, but is arguably easier than in a centralized system like Twitter or Facebook, where automated tools can help moderators to catch dogpiling as it happens. As someone who both administrates and moderates Mastodon instances, and who believes in Mastodon’s mission to make social media a more pleasant and human-centric place, this post is my attempt to define the attack vector and propose strategies to prevent it in the future.
(tags: mastodon abuse twitter wilw harassment moderation)
Biohackers Encoded Malware in a Strand of DNA
a group of researchers from the University of Washington has shown for the first time that it’s possible to encode malicious software into physical strands of DNA, so that when a gene sequencer analyzes it the resulting data becomes a program that corrupts gene-sequencing software and takes control of the underlying computer.
(tags: hacking malware security sequencing genome biohacking dna)
-
Training an MT model without access to any translation resources at training time (known as unsupervised translation) was the necessary next step. Research we are presenting at EMNLP 2018 outlines our recent accomplishments with that task. Our new approach provides a dramatic improvement over previous state-of-the-art unsupervised approaches and is equivalent to supervised approaches trained with nearly 100,000 reference translations. To give some idea of the level of advancement, an improvement of 1 BLEU point (a common metric for judging the accuracy of MT) is considered a remarkable achievement in this field; our methods showed an improvement of more than 10 BLEU points. This is an important finding for MT in general and especially for the majority of the 6,500 languages in the world for which the pool of available translation training resources is either nonexistent or so small that it cannot be used with existing systems. For low-resource languages, there is now a way to learn to translate between, say, Urdu and English by having access only to text in English and completely unrelated text in Urdu – without having any of the respective translations.
(tags: unsupervised-learning ml machine-learning ai translation facebook)
-
scenes from London transit infrastructure. There's a fantastic 1960s vibe off these
(tags: london tube public-transport prints art gail-brodholt via:mltshp)
This Music Theory Professor Just Showed How Stupid and Broken Copyright Filters Are - Motherboard
Kaiser then decided to test Google’s system more fully. He opened a new YouTube account named Labeltest, and began sharing additional examples of copyright-free music. “I quickly received Content ID notifications for copyright-free music by Bartok, Schubert, Puccini, and Wagner,” Kaiser said. “Again and again, YouTube told me that I was violating the copyright of these long-dead composers, despite all of my uploads existing in the public domain.” Google’s Content ID is the result of more than $100 million in investment funds and countless development hours. Yet Kaiser found the system was largely incapable of differentiating between copyrighted music and content in the public domain. And the appeals process that Google has erected to tackle these false claims wasn’t any better.
(tags: content-id copyright copyright-filtering youtube fail google public-domain ip music filtering bartok schubert wagner puccini)
Google Online Security Blog: Introducing the Tink cryptographic software library
Tink aims to provide cryptographic APIs that are secure, easy to use correctly, and hard(er) to misuse. Tink is built on top of existing libraries such as BoringSSL and Java Cryptography Architecture, but includes countermeasures to many weaknesses in these libraries, which were discovered by Project Wycheproof, another project from our team. With Tink, many common cryptographic operations such as data encryption, digital signatures, etc. can be done with only a few lines of code.
Yahoo! are scanning your email contents and selling data to advertisers
For example: Amazon will no longer mail full receipt text as advertisers were believed to be extracting it
How network clients need to participate in fault tolerance
Top tips on best practices here:
Colm's thread on shuffle sharding reminded me of how important it is that clients participate in fault tolerance, and how frustrated I get when a client library *doesn't* do this by default in my application. Let's talk about some best practices!
Bottom line: use Hystrix :)(tags: retries fault-tolerance networking tcp http exponential-backoff ip)
Surgical team collaborates with McLaren F1 to improve processes
On the screen was a motor racing grand prix and, as they watched, the two men became aware of the similarities between the handover disciplines from theatre to intensive care and what they were seeing in the pit of a Formula One racing team. From that moment began a collaboration between the leaders of Great Ormond Street's surgical and intensive care units, first with the McLaren F1 racing team and then with Ferrari's team chief Jan Todt, technical guru Ross Brawn and, in particular, race technical director Nigel Stepney. They worked together at their home base in Modena, Italy, in the pits of the British Grand Prix and in the Great Ormond Street theatre and intensive care ward. The major restructuring of the patient handover procedure, resulting directly from the input of the F1 pit technicians, will soon be described in two scientific publications. "It is not too early to say that, when we look at the number of critical instances we encounter, they have reduced markedly since we introduced the modified training protocol developed from what we have learned from Formula 1," said Prof Elliott. The single A4 sheet of paper, which contained the flow diagram of Ferrari's pit procedure, became several pages of twice that size when Mr Stepney and his colleagues at Ferrari were confronted with the critical transfer from operating theatre to recovery room at Great Ormond Street.
(tags: collaboration cross-discipline surgery formula-1 mclaren pitstops cardiac)
Fixing Slow Macbook WIFI Reconnect after sleep – airbag moments
A command line hack to fix the common Macbook wifi problem where wifi won't reconnect after opening the lid without a manual reconnect
-
Or as jwz put it, a brief history of generative art
(tags: art generative-art computer-art algorithms graphics via:jwz)
Russian Trolls Used Vaccine Debate to Sow Discord, Study Finds - The New York Times
But instead of picking a side, researchers said, the trolls and bots they programmed hurled insults at both pro- and anti-vaccine advocates. Their only intent, the study concluded, seemed to be to raise the level of hostility. “You see this pattern,” said David A. Broniatowski, a computer engineer at George Washington University and lead author of the study, which was published Thursday in the American Journal of Public Health. “On guns, or race, these accounts take opposite sides in lots of debates. They’re about sowing discord.”
So the Russian strategy is basically more of a "Hail Eris" than a "Hail Mary"?
spotify/dockerfile-maven: A set of Maven tools for dealing with Dockerfiles
'a Maven plugin and extension which help to seamlessly integrate Docker with Maven. The design goals are: Don't try to do anything fancy. Dockerfiles are how you build Docker projects; that's what this plugin uses. They are mandatory. Make the Docker build process integrate with the Maven build process. If you bind the default phases, when you type mvn package, you get a Docker image. When you type mvn deploy, your image gets pushed. Make the goals remember what you are doing. You can type mvn dockerfile:build and later mvn dockerfile:tag and later mvn dockerfile:push without problems. This also eliminates the need for something like mvn dockerfile:build -DalsoPush; instead you can just say mvn dockerfile:build dockerfile:push. Integrate with the Maven build reactor. You can depend on the Docker image of one project in another project, and Maven will build the projects in the correct order. This is useful when you want to run integration tests involving multiple services.' Looks very nice and well-run -- shame it's Maven instead of Gradle...
One in five genetics papers contains errors thanks to Microsoft Excel | Science | AAAS
'Autoformatting in Microsoft Excel has caused many a headache — but now, a new study shows that one in five genetics papers in top scientific journals contains errors from the program, The Washington Post reports. The errors often arose when gene names in a spreadsheet were automatically changed to calendar dates or numerical values.'
(tags: science microsoft excel spreadsheets autoformatting clippy fail papers genetics)
Filter before you parse: faster analytics on raw data with Sparser
Super fast JSON parsing. Has some interesting similarities to some code I wrote in SpamAssassin, as it turns out!
(tags: json parsing performance coding algorithms)
I came across this cocktail in Pals, in Catalonia, in 30 degree heat, a few weeks back -- I saw it on the menu at the cafe in the square of the old town, and had to give it a go. It's incredible. Basically, it's lager mixed with a lemon granita -- like a beer slushy. Nothing is better at thirst quenching on a hot day, and best of all it's quite low in alcohol so no worries about lorrying into it during the daytime :)
This year at Groovefest, our yearly get together/mini-festival, I got to serve up a few, with great results -- they were quite popular. So here's the recipe!
First off, a day or two in advance, make a batch of lemon granita. I based mine on this recipe which I'll copy here just in case the original goes away:
Lemon Granita
Serves: about 8
Ingredients:
- 3-4 lemons
- 1L water
- 150g of sugar
Method:
Zest the lemons and set the zest aside. Juice the lemons until you have 150ml juice (you may not need all of them).
Add the water and sugar to a large pan and bring to the boil. Reduce to a simmer and cook for 2 minutes, stirring to dissolve the sugar.
Add the lemon juice and zest, remove from the heat and cover. Set aside to cool for 20 minutes.
Strain the mixture into 2 containers that will fit in your freezer and leave to cool to room temperature.
Freeze until the mixture is partially frozen, which should take several hours. (I just left them overnight)
Remove the granita from the freezer and leave at room temperature until you can break it into chunks with a large spoon or fork.
Either transfer to a blender or food processor and blitz, or break it up with a fork. It doesn't need to be perfectly smooth and snowy -- a slushy texture is just right for this drink.
Store in the freezer. Take out 30 minutes before serving and break it up again with a fork.
Clara Con Limón Granizado
To serve: half-fill a half-pint glass with the lemon granita. Pour the beer on top to fill the glass. Stir once or twice to mix. Enjoy!
PS: I think -- not sure as my Catalan is pretty terrible -- it may be a clara granitzada in Catalonia...
The BARR-C:2018 Embedded C Coding Standard
'Barr Group's Embedded C Coding Standard was developed to minimize bugs in firmware by focusing on practical rules that keep bugs out--while also improving the maintainability and portability of embedded software. The coding standard details a set of guiding principles as well as specific naming conventions and other rules for the use of data types, functions, preprocessor macros, variables and much more. Individual rules that have been demonstrated to reduce or eliminate certain types of bugs are highlighted. In this latest version, BARR-C:2018, the stylistic coding rules have been fully harmonized with MISRA C: 2012, while helping embedded system designers reduce defects in firmware written in C and C++.'
Nosferatu is only viewable today due to piracy
'In 1922 a German court ordered all prints and negatives of Nosferatu destroyed following a copyright dispute with the widow of Bram Stoker. The film only exists today because of piracy. One copy survived and somehow found it's way to America, where Dracula was already in the public domain. That's it. That's the only reason you've ever seen the granddaddy of all horror movies.'
(tags: dracula bram-stoker nosferatu piracy licensing movies history)
Anatomy of a tabloid Fortnite front page story
Interesting writeup of how the UK tabloids concoct their scare stories, rustling up "victims" and paying them and their agents fees of thousands of pounds
(tags: fortnite pokemon-go gaming tabloids uk newspapers truth the-sun games)
Hacker Finds Hidden 'God Mode' on Old VIA C3 x86 CPUs
Domas discovered the backdoor, which exists on VIA C3 Nehemiah chips made in 2003, by combing through filed patents. He found one — US8341419 — that mentioned jumping from ring 3 to ring 0 and protecting the machine from exploits of model-specific registers (MSRs), manufacturer-created commands that are often limited to certain chipsets. Domas followed the "trail of breadcrumbs," as he put it, from one patent to another and figured out that certain VIA chipsets were covered by the patents. Then he collected many old VIA C3 machines and spent weeks fuzzing code. He even built a testing rig consisting of seven Nehemiah-based thin clients hooked up to a power relay that would power-cycle the machines every couple of minutes, because his fuzzing attempts would usually crash the systems. After three weeks, he had 15 GB of log data — and the instructions to flip on the backdoor in the hidden RISC chip.
(via Nelson)
How I gained commit access to Homebrew in 30 minutes
If I were a malicious actor, I could have made a small, likely unnoticed change to the openssl formulae, placing a backdoor on any machine that installed it. If I can gain access to commit in 30 minutes, what could a nation state with dedicated resources achieve against a team of 17 volunteers? How many private company networks could be accessed? How many of these could be used to escalate to large scale data breaches? What other package management systems have similar weaknesses? This is my growing concern, and it’s been proven time and time again that package managers, and credential leaks, are a weak point in the security of the internet, and that supply chain attacks are a real and persistent threat. This is not a weakness in Homebrew, but rather a systemic problem in the industry, and one where we need more security research.
-
Galway-based refurb phone retailer, recommended by co-worker Ciaran where he picked up his Pixel
-
"rsync for cloud storage" - Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfiles, Google Cloud Storage, Yandex Files
(tags: backup github sync cloud s3 storage rsync rclone google aws dropbox backblaze yandex onedrive)
People Think This Whole QAnon Conspiracy Theory Is A Prank On Trump Supporters
This, if true, is the most gloriously Discordian thing ever.
"Let us take for granted, for a while, that QAnon started as a prank in order to trigger right-wing weirdos and have a laugh at them. There's no doubt it has long become something very different. At a certain level it still sounds like a prank. But who's pulling it on whom?" they [Roberto Bui, Giovanni Cattabriga, and Federico Guglielmi] said.
(tags: q conspiracy politics trump qanon luther-blissett discordianism wu-ming funny crazy)
Why JSON isn't a good configuration language
solid +1s on these points
(tags: json configuration languages coding formats)
-
Aerial imagery can play an important role in disaster response operations, enabling response teams to identify and prioritize hardest-hit areas, conduct damage assessments, and plan response activities. Existing tools make this relatively easy in connected environments; users can browse high-resolution satellite imagery catalogs and download the relevant imagery, and can process drone imagery using online tools. Current solutions don’t work well in disconnected environments, however. Even offline tools lack the storage space and processing power to be effective for addressing large areas. This blog post shows how rugged, portable Amazon Web Services (AWS) servers can be turned into a kit that’s mega-powerful, deployable, and purpose-built for post-disaster imagery operations. This can help humanitarians and government agencies to more accurately and efficiently conduct damage assessments and identify hardest-hit areas, potentially making a real difference in the aftermath of a natural disaster.
(tags: snowball aws humanitarian emergency-response osm openstreetmap mapping aid disasters)
Labour HQ used Facebook ads to deceive Jeremy Corbyn during election campaign | News | The Times
Campaign chiefs at Labour HQ hoodwinked their own leader because they disapproved of some of Corbyn’s left-wing messages. They convinced him they were following his campaign plans by spending just £5,000 on adverts solely designed to be seen by Corbyn, his aides and their favourite journalists, while pouring far more money into adverts with a different message for ordinary voters.
(tags: advertising politics crazy facebook jeremy-corbyn microtargeting ads uk labour-party)
15 Key Takeaways from the Serverless Talk at AWS Startup Day
Best current practices for AWS Lambda usage. (still pretty messy/hacky/Rube-Goldberg-y from the looks of it tbh)
-
niftierideology on twitter:
Haskell is very simple. Everything is composed of Functads which are themselves a Tormund of Gurmoids, usually defined over the Devons. All you have to do is stick one Devon inside a Tormund and it yields Reverse Functads (Actually Functoids) you use to generate Unbound Gurmoids.
(tags: haskell functors functads tormund-of-gurmoids jargon funny satire coding languages)
Facebook's new rules for moderators on dealing with far-right pages are awful
This is a total shitshow. Facebook needs to sort this out, it is not remotely desirable.
Facebook: "We allow to call for the creation of white ethno-states." In other words, Facebook is officially ok with people calling for ethnic cleansing and genocide. The time for Facebook to hire/consult with experts re: the far-right was about three or four years ago. That they now *agree* with the rationale of Alt-Reich rebranding in 2018 shows that this company is simply not fit for purpose. [...] t's quite something that Facebook's advice to their moderators literally mirrors Nazi propaganda: "Being interested in and caring for one’s kind is not to disparage foreign peoples and races"- Nazi party pamphlet "Why the Aryan Law?" (1934)
(tags: facebook awful moderation far-right nazis fascism ethnic-cleansing genocide social-media fail)
How my research on DNA ancestry tests became "fake news"
I was not surprised to see our research twisted by fake news and satire websites. Conspiracy theories are meant to be just as entertaining as they are convincing. They also provide a way out of confronting reality and reckoning with facts that don’t confirm preexisting worldviews. For white nationalists and racists, if test results showed traces of African American or Jewish ancestry, either the tests did not work, or the results were planted by some ideologically motivated scientists, or the tests were part of a global war against whites. With conspiracy theories, debunking is rarely useful because the individual is often searching for an interpretation that confirms their prior beliefs. As such, DNA conspiracy theories allow white supremacists to plan new escape routes for the traps they laid for themselves long ago. With DNA testing, the one-drop rule—a belief made law in the 1900s that one drop of African blood makes one Black—becomes transmuted genealogically into the one-percent rule, according to which to remain racially white, an individual’s results must show no sign of African or Jewish origin. Through the genealogical lens, American white nationalists consider “one hundred percent European” as good results, which in turn substantiates their “birth right” to the United States as a marker of heredity and conquest.
(tags: racism science fake-news conspiracy genealogy dna dna-testing)
-
Second-hand CPAP machines -- decent prices here, recommended by @Searcher on FP
(tags: cpap second-hand appliances)
Using Kindle Fire's Parental Controls
time to set this up I think
(tags: kindle fire parental-controls devices kids)
The problems with DynamoDB Auto Scaling and how it might be improved
'Based on these observations, we hypothesize that you can make two modifications to the system to improve its effectiveness: trigger scaling up after 1 threshold breach instead of 5, which is in-line with the mantra of “scale up early, scale down slowly”; trigger scaling activity based on actual request count instead of consumed capacity units, and calculate the new provisioned capacity units using actual request count as well. As part of this experiment, we also prototyped these changes (by hijacking the CloudWatch alarms) to demonstrate their improvement.'
(tags: dynamodb autoscaling ops scalability aws scaling capacity)
Summer Fruit Shrub Recipe - NYT Cooking
as recommended by Nelson -- I've been meaning to make one
Evolution of Application Data Caching : From RAM to SSD
Memcached provides an external storage shim called extstore, that supports storing of data on SSD (I2) and NVMe (I3). extstore is efficient in terms of cost & storage device utilization without compromising the speed and throughput. All the metadata (key & other metadata) is stored in RAM whereas the actual data is stored on flash.
(tags: memcached netflix services storage memory ssd nvme extstore caching)
Goodbye Microservices: From 100s of problem children to 1 superstar · Segment Blog
Super-happy we resisted many of the microservices gospels and dodged this bullet
(tags: architecture microservices monolith git monorepo)
Centrifuge: a reliable system for delivering billions of events per day
Nice scale-up service to solve the multi-tenant, multi-target queueing problem with good customer isolation from Segment
(tags: queueing architecture dead-letter-queue kafka segment multi-tenant isolation)
-
'This website has been designed to help you, the passenger, understand your rights and entitlements in the event that your air travel plans are disrupted.' from the Commission for Aviation Regulation. See also thread from Sinead Ryan at https://twitter.com/sinead_ryan/status/1016628694427885568
(tags: consumer aviation flights ryanair aer-lingus ireland rights flying)
open source ham radio hardware in the Thai cave rescue
the Heyphone, a voice radio designed by UK radio ham, John Hey
(tags: ham-radio heyphone voice radios cave rescue thailand)
-
This is disappointing. Basho was very promising.
An investment fund and its manager have been ordered to pay up $20.3m after "misinformation, threats and combative behaviour" helped put NoSQL database biz Basho on a "greased slide to failure". As reported by The Register, the once-promising biz, which developed the Riak distributed database, faded away last year amid severe criticisms of the way its major investor, Georgetown Capital Partners, operated. These centred around the control the investment firm and boss Chester Davenport gained over Basho, and how that power was used to block other funders and push out dissenting voices, with the hope of selling the company off fast.
-
S3 + Cloudfront + ACM + Route53, automated.
There are a bunch of free/cheap options for hosting static sites (just html/css/js) out there: github pages, netlify, firebase hosting - but when I want to build a bulletproof static site "for real", my go-to toolset is S3 for hosting with Cloudfront caching in front of it. I figured that after a few times doing this, I'd automate it. There are a few pre-existing tools for parts of this, but none I could find that did the whole thing from registration through uploading and Cloudfront invalidation.
(tags: cli acm aws s3 cloudfront route53 static-sites web html hosting)
Hospitality boom: What’s happening with Dublin’s bars and restaurants?
Good article with an insider look at what's going on with venues, bars and restaurants in Dublin:
They call it “meanwhile use” in property developer shorthand. It’s the market or cafe that slots itself temporarily into a building earmarked for redevelopment. Rent is low and terms are flexible. Cheap space is hewn out of a lull. Cool creative things happen. You don’t need the backing of a private equity fund or a multinational developer to set up a cafe or restaurant. No one is asking for a six-figure sum just to hand you the keys. [...] That era has gone. Landlords are back in the driving seat. Between the canals the key money, a once-off upfront payment just to get the keys, is mind-boggling. The pace of new openings seems relentless and “not particularly sustainable”, as one industry insider puts it: how many burritos do you have to sell when you’ve paid €500,000 upfront, before the costs of fitting it out, staffing it and paying the rent?
(tags: dublin hospitality bars restaurants pubs nightlife landlords property boom key-money)
-
EUR40 per day from the Dutch Bike Shop in Belfield
(tags: dutch-bikes bakfiets cargo-bikes cycling bikes rental dublin)
Google Cloud Platform Blog: Introducing Jib
'build Java Docker images better':
Jib takes advantage of layering in Docker images and integrates with your build system to optimize Java container image builds in the following ways: Simple - Jib is implemented in Java and runs as part of your Maven or Gradle build. You do not need to maintain a Dockerfile, run a Docker daemon, or even worry about creating a fat JAR with all its dependencies. Since Jib tightly integrates with your Java build, it has access to all the necessary information to package your application. Any variations in your Java build are automatically picked up during subsequent container builds. Fast - Jib takes advantage of image layering and registry caching to achieve fast, incremental builds. It reads your build config, organizes your application into distinct layers (dependencies, resources, classes) and only rebuilds and pushes the layers that have changed. When iterating quickly on a project, Jib can save valuable time on each build by only pushing your changed layers to the registry instead of your whole application. Reproducible - Jib supports building container images declaratively from your Maven and Gradle build metadata, and as such can be configured to create reproducible build images as long as your inputs remain the same.
(tags: build google java docker maven gradle coding builds jars fat-jars packaging)
Saving a non-profit six figures a year using Squarespace, Airtable and Glitch.com
Airtable in particular sounds like a lovely tool for small-scale users
(tags: serverless airtable google squarespace glitch tools web ops)
-
PDF with a few good tips on wifi layout, AP placement etc. Also recommended: https://www.youtube.com/watch?v=Adep0SeOjAE&feature=youtu.be&t=17m22s (via irldexter)
(tags: via:irldexter wifi 802.11 wireless ops networking)
What I’ve learned from nearly three years of enterprise Wi-Fi at home
I am happy to note that I've grown out of this kind of pain (I think)....
Do you just want better Wi-Fi in every room? Consider buying a Plume or Amplifi or other similar plug-n-go mesh system. On the other hand, are you a technically proficient network kind of person who wants to build an enterprise-lite configuration at home? Do you dream of VLANs and port profiles and lovingly tweaked firewall rules? Does the idea of crawling around in your attic to ceiling-mount some access points sound like a fun way to kill a weekend? Is your office just too quiet for your liking? Buy some Ubiquiti Unifi gear and enter network nerd nirvana.
(tags: networking wifi wireless ubiquiti sdn vlans home ops)
Large breweries ‘pay publicans not to stock smaller companies’ beer, cider’
Good on Alan Kelly TD for raising the issue -- it is clearly happening and is clearly anti-competitive market manipulation by the big brewers.
He said a pub in Cork he was in recently had 21 taps of which 19 were from one brewing company and that smaller breweries tried to get some of that business. Mr Kelly claimed similar practices were occurring in pubs across all counties and that the statutory body that deals with anti-competitive practices, the Competition and Consumer Protection Commission (CCPC), had received a number of complaints but did not have the resources to deal with the issue. However, Minister of State Pat Breen said “after a robust examination” the CCPC found it did not have grounds to suspect a breach of the law. Mr Kelly said that “the dogs in the street know what is happening here” and that the Minister’s response was insulting to the industry. He said the CCPC would need large resources to investigate the issue and “large amounts of cash and resources are being used, and these practices are happening in large pubs in all cities and towns in Ireland”.
(tags: ireland brewing beer pubs ccpc anti-competitive business alan-kelly dail)
React Native: A retrospective from the mobile-engineering team at Udacity
I think it's safe to say they didn't like it
(tags: react react-native udacity coding javascript android ios)
-
a simple JVMTI agent that forcibly terminates the JVM when it is unable to allocate memory or create a thread. This is important for reliability purposes: an OutOfMemoryError will often leave the JVM in an inconsistent state. Terminating the JVM will allow it to be restarted by an external process manager.
This is apparently still useful despite the existence of '-XX:ExitOnOutOfMemoryError' as of java 8, since that may somehow still fail occasionally. "Stylish" browser extension steals all your internet history | Robert Heaton
'Stylish, the popular CSS userstyle browser extension [collects] complete browser history, including sites scraped from Google results. Instant uninstall.' (via Andy Baio)
(tags: privacy browser extensions stylish css history data-protection)
-
There are twice as many people cycling as there are people in cars on the quays in Dublin at the morning rush hour, a video survey by the Dublin Cycling Campaign has found.
This doesn't surprise me at all -- I would be in that number too, except I now avoid the quays as they are too dangerous to cycle on due to the heavy traffic! A segregated cycle route is greatly needed.(tags: cycling dublin safety cars driving dublin-cycling-campaign liffey-cycle-route)
-
Glowforge laser-cut a sundial, customised for your very own corner of planet Earth
Nginx tuning tips: TLS/SSL HTTPS – Improved TTFB/latency
Must do these soon on jmason.org / taint.org et al.
‘Nothing to worry about. The water is fine’: how Flint poisoned its people | News | The Guardian
The anxiety reverberated all the way to the state capital, Lansing, where Governor Rick Snyder was weeks away from winning reelection. His chief legal counsel, Michael Gadola, wrote in an email: “To anyone who grew up in Flint as I did, the notion that I would be getting my drinking water from the Flint River is downright scary. Too bad the [emergency manager] didn’t ask me what I thought, though I’m sure he heard it from plenty of others. My mom is a city resident. Nice to know she’s drinking water with elevated chlorine levels and fecal coliform … They should try to get back on the Detroit system as a stopgap ASAP before this thing gets too far out of control.”
(tags: flint michigan bureaucracy water poisoning corrosion poison us-politics environment taxes)
The iconic _Fountain_ (1917) was not created by Marcel Duchamp
In 1982 a letter written by Duchamp came to light. Dated 11 April 1917, it was written just a few days after that fateful exhibit. It contains one sentence that should have sent shockwaves through the world of modern art: it reveals the true creator behind Fountain – but it was not Duchamp. Instead he wrote that a female friend using a male alias had sent it in for the New York exhibition. Suddenly a few other things began to make sense. Over time Duchamp had told two different stories of how he had created Fountain, but both turned out to be untrue. An art historian who knew Duchamp admitted that he had never asked him about Fountain, he had published a standard-work on Fountain nevertheless. The place from where Fountain was sent raised more questions. That place was Philadelphia, but Duchamp had been living in New York. Who was living in Philadelphia? Who was this ‘female friend’ that had sent the urinal using a pseudonym that Duchamp mentions? That woman was, as Duchamp wrote, the future. Art history knows her as Elsa von Freytag-Loringhoven. She was a brilliant pioneering New York dada artist, and Duchamp knew her well. This glaring truth has been known for some time in the art world, but each time it has to be acknowledged, it is met with indifference and silence. This article addresses the true authorship of Fountain from the perspective of the latest evidence, collected by several experts. The opinions they voice offer their latest insights. Their accumulation of evidence strengthens the case to its final conclusion. To attribute Fountain to a woman and not a man has obvious, far-reaching consequences: the history of modern art has to be rewritten. Modern art did not start with a patriarch, but with a matriarch. What power structure in the world of modern art prohibits this truth to become more widely known and generally accepted? Ultimately this is one of the larger questions looming behind the authorship of Fountain. It sheds light on the place and role of the female artist in the world of modern art.
(tags: elsa-von-freytag-loringhoven marcel-duchamp modern-art history art-history scandals credit art fountain women)
Cory Doctorow: Zuck’s Empire of Oily Rags
the sophisticated targeting systems available through Facebook, Google, Twitter, and other Big Tech ad platforms made it easy to find the racist, xenophobic, fearful, angry people who wanted to believe that foreigners were destroying their country while being bankrolled by George Soros. Remember that elections are generally knife-edge affairs, even for politicians who’ve held their seats for decades with slim margins: 60% of the vote is an excellent win. Remember, too, that the winner in most races is “none of the above,” with huge numbers of voters sitting out the election. If even a small number of these non-voters can be motivated to show up at the polls, safe seats can be made contestable. In a tight race, having a cheap way to reach all the latent Klansmen in a district and quietly inform them that Donald J. Trump is their man is a game-changer. Cambridge Analytica are like stage mentalists: they’re doing something labor-intensive and pretending that it’s something supernatural. A stage mentalist will train for years to learn to quickly memorize a deck of cards and then claim that they can name your card thanks to their psychic powers. You never see the unglamorous, unimpressive memorization practice. Cambridge Analytica uses Facebook to find racist jerks and tell them to vote for Trump and then they claim that they’ve discovered a mystical way to get otherwise sensible people to vote for maniacs.
(tags: facebook politics surveillance cory-doctorow google twitter advertising elections cambridge-analytica racism nazis)
Dormio: Interfacing with Dreams to Augment Human Creativity — MIT Media Lab
Using Dormio you fall asleep as you normally would, but the transition into stage 2 sleep is tracked and interrupted. This suspends you in a semi-lucid state where microdreams are inceptable, allowing direction of your dreams.
(tags: dreaming dreams science neuroscience brain sleep lucid-dreaming via:fp dormio)
Facial recognition software is not ready for use by law enforcement | TechCrunch
This is a pretty amazing op-ed from the CEO of a facial recognition software development company:
Facial recognition technologies, used in the identification of suspects, negatively affects people of color. To deny this fact would be a lie. And clearly, facial recognition-powered government surveillance is an extraordinary invasion of the privacy of all citizens — and a slippery slope to losing control of our identities altogether. There’s really no “nice” way to acknowledge these things. I’ve been pretty clear about the potential dangers associated with current racial biases in face recognition, and open in my opposition to the use of the technology in law enforcement. As the black chief executive of a software company developing facial recognition services, I have a personal connection to the technology, both culturally and socially. Having the privilege of a comprehensive understanding of how the software works gives me a unique perspective that has shaped my positions about its uses. As a result, I (and my company) have come to believe that the use of commercial facial recognition in law enforcement or in government surveillance of any kind is wrong — and that it opens the door for gross misconduct by the morally corrupt.
(tags: techcrunch facial-recognition computer-vision machine-learning racism algorithms america)
Yelp, The Red Hen, And How All Tech Platforms Are Now Pawns In The Culture War
Though the brigading of review sites and doxxing behavior isn’t exactly new, the speed and coordination is; one consequence of a never-ending information war is that everyone is already well versed in their specific roles. And across the internet, it appears that technology platforms, both big and small, must grapple with the reality that they are now powerful instruments in an increasingly toxic political and cultural battle. After years attempting to dodge notions of bias at all costs, Silicon Valley’s tech platforms are up against a painful reality: They need to expect and prepare for the armies of the culture war and all the uncomfortable policing that inevitably follows. Policing and intervening isn’t just politically tricky for the platforms, it’s also a tacit admission that Big Tech’s utopian ideologies are deeply flawed in practice. Connecting everyone and everything in an instantly accessible way can have terrible consequences that the tech industry still doesn’t seem to be on top of. Silicon Valley frequently demos a future of seamless integration. It’s a future where cross-referencing your calendar with Yelp, Waze, and Uber creates a service that’s greater than the sum of its parts. It’s an appealing vision, but it is increasingly co-opted by its darker counterpart, in which major technology platforms are daisy-chained together to manipulate, abuse, and harass.
(tags: culture-war technology silicon-valley yelp reviews red-hen dystopia spam doxxing brigading politics)
AWS Developer Forums: m5.xlarge in us-east-1 has intermittent DNS resolution failures
likewise for C5 instance types -- reportedly still an issue
ICE's Risk Classification Assessment turned into a digital rubber stamp
If this report is correct, this "statistics-based" risk classification tool is just a cruel joke:
To conform to Trump’s policies, Reuters has learned, ICE modified a tool officers have been using since 2013 when deciding whether an immigrant should be detained or released on bond. The computer-based Risk Classification Assessment uses statistics to determine an immigrant’s flight risk and danger to society. Previously, the tool automatically recommended either “detain” or “release.” Last year, ICE spokesman Bourke said, the agency removed the “release” recommendation
(tags: immigration statistics machine-learning rubber-stamping fake-algorithms whitewashing ice us-politics)
Visa admits 5m payments failed over a broken switch
“We operate two redundant data centres in the UK, meaning that either one can independently handle 100% of the transactions for Visa in Europe. In normal circumstances, the systems are synchronised and either centre can take over from the other immediately … in this instance, a component with a switch in our primary data centre suffered a very rare partial failure which prevented the backup switch from activating.”
10-hour Microsoft Azure outage in Europe
Service availability issue in North Europe Summary of impact: From 17:44 on 19 Jun 2018 to 04:30 UTC on 20 Jun 2018 customers using Azure services in North Europe may have experienced connection failures when attempting to access resources hosted in the region. Customers leveraging a subset of Azure services may have experienced residual impact for a sustained period post-mitigation of the underlying issue. We are communicating with these customers directly in their Management Portal. Preliminary root cause: Engineers identified that an underlying temperature issue in one of the datacenters in the region triggered an infrastructure alert, which in turn caused a structured shutdown of a subset of Storage and Network devices in this location to ensure hardware and data integrity. Mitigation: Engineers addressed the temperature issue, and performed a structured recovery of the affected devices and the affected downstream services.
The specific services were: 'Virtual Machines, Storage, SQL Database, Key Vault, App Service, Site Recovery, Automation, Service Bus, Event Hubs, Data Factory, Backup, API management, Log Analytics, Application Insight, Azure Batch Azure Search, Redis Cache, Media Services, IoT Hub, Stream Analytics, Power BI, Azure Monitor, Azure Cosmo DB or Logic Apps in North Europe'. Holy cow(tags: microsoft outages fail azure post-mortems cooling-systems datacenters)
-
We’ve compiled a list of organizations that are mobilizing to try and help children that have been separated from their parents at the Texas-Mexico border.
(tags: texas children immigration family-separations us-politics usa charity)
Save on your AWS bill with Kubernetes Ingress
decent into to Kubernetes Ingress and the Ambassador microservices API gateway built on Envoy Proxy
(tags: envoy proxying kubernetes aws elb load-balancing ingress ambassador ops)
Is America Ready for a Global Pandemic? - The Atlantic
The egg-based [vaccine manufacture] system depends on chickens, which are themselves vulnerable to flu. And since viruses can mutate within the eggs, the resulting vaccines don’t always match the strains that are circulating. But vaccine makers have few incentives to use anything else. Switching to a different process would cost billions, and why bother? Flu vaccines are low-margin products, which only about 45 percent of Americans get in a normal year. So when demand soars during a pandemic, the supply is not set to cope. American hospitals, which often operate unnervingly close to full capacity, likewise struggled with the surge of patients. Pediatric units were hit especially hard by H1N1, and staff became exhausted from continuously caring for sick children. Hospitals almost ran out of the life-support units that sustain people whose lungs and hearts start to fail. The health-care system didn’t break, but it came too close for comfort—especially for what turned out to be a training-wheels pandemic. The 2009 H1N1 strain killed merely 0.03 percent of those it infected; by contrast, the 1918 strain had killed 1 to 3 percent, and the H7N9 strain currently circulating in China has a fatality rate of 40 percent. That the U.S. could be so ill-prepared for flu, of all things, should be deeply concerning. The country has a dedicated surveillance web, antiviral drugs, and an infrastructure for making and deploying flu vaccines. None of that exists for the majority of other emerging infectious diseases.
(tags: vaccines health diseases h1n1 flu pandemics future scary)
Here's how you can fight family separation at the border
Slate's list of organisations fighting this horrible policy
(tags: family-separation law immigration us-politics america)
In America, Naturalized Citizens No Longer Have an Assumption of Permanence | The New Yorker
Michael Bars, the U.S.C.I.S. spokesman, told the Washington Examiner that the agency is hiring dozens of lawyers for the new task force. The mandate, according to both Cissna and Bars, is to find people who deliberately lied on their citizenship applications, not those who made innocent mistakes. The distinction is fuzzier than one might assume. Back in 1989, I had to make a decision about whether to lie on my citizenship application. At the time, immigration law banned “aliens afflicted with sexual deviation,” among others suffering from “psychopathic personality,” from entry to the United States. I had come to this country as a fourteen-year-old, in 1981, but I had been aware of my “sexual deviation” at the time, and this technically meant that I should not have entered the country. [....] Over the years, the applications for both citizenship and permanent residence have grown ever longer, filling with questions that seem to be designed to be used against the applicant. Question 26 on the green-card application, for example, reads, “Have you EVER committed a crime of any kind (even if you were not arrested, cited, charged with, or tried for that crime)?” ... The question does not specify whether it refers to a crime under current U.S. law or the laws of the country in which the crime might have been committed. In the Soviet Union of my youth, it was illegal to possess foreign currency or to spend the night anywhere where you were not registered to live. In more than seventy countries, same-sex sexual activity is still illegal. On closer inspection, just about every naturalized citizen might look like an outlaw, or a liar.
(tags: law immigration us-politics america citizenship naturalization history)
A few observations on the bikesharing systems in China
Mindblowing Twitter thread. The variety of systems, most of which are barely impinging on our systems over here in Ireland!
(tags: china bikesharing cycling bikes transit public-transit commuting)
-
Turns out I was wrong. This is a big one. And everyone should be using it. Hash tables should not be prime number sized and they should not use an integer modulo to map hashes into slots. Fibonacci hashing is just better. Yet somehow nobody is using it and lots of big hash tables (including all the big implementations of std::unordered_map) are much slower than they should be because they don’t use Fibonacci Hashing.
Apparently this is binary multiplicative hashing, and Google's brotli, webp, and Snappy libs all use a constant derived heuristically from a compression test corpus along the same lines (see comments). (Via Michael Fogleman)(tags: algorithms hashing hash fibonacci golden-ratio coding hacks brotli webp snappy hash-tables hashmaps load-distribution)
-
In statistics, Halton sequences are sequences used to generate points in space for numerical methods such as Monte Carlo simulations. Although these sequences are deterministic, they are of low discrepancy, that is, appear to be random for many purposes. They were first introduced in 1960 and are an example of a quasi-random number sequence.
(tags: algorithms graphics random randomness coding monte-carlo-simulation number-sequences)
The best Mario Kart character according to data science
Unless you’re going all-in on acceleration, it looks like a heavy character is the way to go; the two heaviest character classes (Wario and Donkey Kong) account for 11/15 of the Pareto-optimal configurations.
Wario/Sports Bike/Slick or Wario/Gold Standard/Slick get the top billing!
Taming the Beast: How Scylla Leverages Control Theory to Keep Compactions Under Control - ScyllaDB
This is a really nice illustration of the use of control theory to set tunable thresholds automatically in a complex storage system. Nice work Scylla:
At any given moment, a database like ScyllaDB has to juggle the admission of foreground requests with background processes like compactions, making sure that the incoming workload is not severely disrupted by compactions, nor that the compaction backlog is so big that reads are later penalized. In this article, we showed that isolation among incoming writes and compactions can be achieved by the Schedulers, yet the database is still left with the task of determining the amount of shares of the resources incoming writes and compactions will use. Scylla steers away from user-defined tunables in this task, as they shift the burden of operation to the user, complicating operations and being fragile against changing workloads. By borrowing from the strong theoretical background of industrial controllers, we can provide an Autonomous Database that adapts to changing workloads without operator intervention.
(tags: scylladb storage settings compaction automation thresholds control-theory ops cassandra feedback)
Val on Programming: Making a Datomic system GDPR-compliant
Proposed solution: complementing Datomic with an erasure-aware key/value store. In cases where Excision is not a viable solution, the solution I've come up with is store to privacy-sensitive values in a complementary, mutable KV store, and referencing the corresponding keys from Datomic.
This seems to be turning into a common pattern for GDPR compliant storage.(tags: gdpr privacy clojure datomic data-protection storage architecture)
Twitter thread regarding GDPR-compliance for append-only logs/event sourcing systems
Martin Kleppmann: "What’s current best practice for GDPR compliance (in particular, right to deletion) in systems with append-only logs/event sourcing/blockchains, which are supposed to keep history forever?" Ben Kehoe: "Crypto delete. The immutable store keeps an encrypted copy, and the key is stored elsewhere. Forget me = throw away the key". That seems to be the most practical suggestion in general in this thread.
(tags: twitter threads gdpr compliance law eu append-only logs blockchain event-sourcing architecture storage kafka kinesis)
Trans kids & the people who hate them
Research (Mental Health of Transgender Children Who Are Supported in Their Identities, Olson et al. 2016) has shown that children whose preferred gender identity is accepted by family and friends have no worse mental health outcomes than other children. But those who are not accepted are much more likely to have mental health issues, self harm or take their own lives. We can take from this that acceptance causes no harm, but non-acceptance causes harm?—?so why are so many people angry with parents for accepting their trans kids?
(tags: trans children kids parenting society gender identity)
The Language of the Trump Administration Is the Language of Domestic Violence | The New Yorker
God this is so awful.
Gaslighting, it needs not be said, is Trump’s preferred mode of communication, and it is encoded in the family-separation policy itself: once their parents have been taken into custody, the children are reclassified as “unaccompanied minors,” their parents effectively disappeared. On Friday, NPR reported on three Guatemalan mothers who were on trial in Alpine, Texas, after D.H.S. flew their children—ages eight, eight, and nine—more than two thousand miles away, to a shelter in Manhattan. “There is no mention in the Border Patrol narrative,” an immigration lawyer told NPR, “that these women had children with them when they entered the United States.” Can you prove this child is yours? Do you even have children? Well, then, where are they?
(tags: children donald-trump new-yorker dhs asylum-seekers)
Woman's Tongue Gets Inseminated By Squid After Eating Undercooked Seafood | IFLScience
As documented in a 2012 edition of the Journal of Parasitology, the foreign bodies were identified as squid spermatophores (sperm-containing capsules) belonging to a Japanese flying squid (Todarodes pacificus). Rather foolishly, the woman had not removed the internal organs of the squid and proceeded to only parboil it for a few seconds before eating it, meaning its spermatophores were still alive and well. “As soon as she put a piece into her mouth, she felt like many 'bugs' were biting her oral mucosa,” the study reads. “She experienced severe sharp pain and spat out the entire portion without swallowing. Despite that, she could feel many small squirming white bug-like organisms penetrating her oral mucosa.”
NOOOOOPE(tags: nope argh disgusting gross squid sperm parasitology spermatophores korea tongue)
Amazon EKS is now GA - Official Discussion Thread and Ask the Experts
r/aws discussion thread on EKS now that it's GA
(tags: eks ga aws kubernetes ops architecture clustering docker)
NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash
This is the Tesla self-crashing car in action. Remember how it works. It visually recognizes rear ends of cars using a BW camera and Mobileye (at least in early models) vision software. It also recognizes lane lines and tries to center between them. It has a low resolution radar system which ranges moving metallic objects like cars but ignores stationary obstacles. And there are some side-mounted sonars for detecting vehicles a few meters away on the side, which are not relevant here. The system performed as designed. The white lines of the gore (the painted wedge) leading to this very shallow off ramp become far enough apart that they look like a lane.[1] If the vehicle ever got into the gore area, it would track as if in a lane, right into the crash barrier. It won't stop for the crash barrier, because it doesn't detect stationary obstacles. Here, it sped up, because there was no longer a car ahead. Then it lane-followed right into the crash barrier. That's the fundamental problem here. These vehicles will run into stationary obstacles at full speed with no warning or emergency braking at all. That is by design. This is not an implementation bug or sensor failure. It follows directly from the decision to ship "Autopilot" with that sensor suite and set of capabilities.
(tags: tesla fail safety self-driving autopilot cars driving sonar radar sensors ai)
-
An archive of 489,506 Irish abortion tweets from the period around the 8th referendum in Ireland
(tags: ireland history analytics archives archival repealthe8th)
-
You could think, as a developer, that the lawyers worry about this kind of fine-grained issue. They don’t. This is one of those situations where they say, well, here’s the risk, you have to make a decision, document it, and be ready to back that up in front of a judge should the soup hit the fan. In this particular case it’s straightforward enough. Are you in control of the presence of data in your database? Yes. It’s up to you to delete it when requested. Are you in control of the data on your harddrive? Yes. It’s up to you to delete it when requested. Are you in control of the operating system implementation or database implementation of deletion? No. Could you get the data back if you wanted to? Yes – but that’s not part of your usual run of business, so why would you explicitly do that? What if some bad dude steals your harddrive and then rummages through it? Ok we are getting a little far-fetched here for most businesses that are not keeping special category data, but if this does happen, then you have failed in your security controls. I guess my overall point here is that GDPR Compliance is a continuum, not a tickbox. You want to be doing the best you can with it and document why you can go so far and not further. The companies that will be getting the big legislative fines are the guys that are willy-nilly exporting special category data out of the EEA en masse without the knowledge of the people associated with that data. The rest of us just need to muddle along as best we can.
(tags: gdpr privacy dev tech coding data-protection law eu storage)
What to Do When a Loved One Is Severely Depressed - The New York Times
This is good advice (or seems to be, at least)
(tags: depression health friends sympathy nytimes medicine advice)
-
what products are available where
How to change JVM arguments at runtime to avoid application restart
This is a super nifty feature of the JVM: turn on and off heap class histogram dumps at runtime, for instance.
java -XX:+PrintFlagsFinal -version|grep manageable
(tags: jvm ops switches cli java heap-dumps memory debugging memory-leaks)
How Ireland’s Abortion Referendum Became a Test Case for Democracy in the Social Media Age
Exploring the "fake news" merchants attempting to subvert the Irish abortion referendum.
On 4chan, a number of users who identified as Irish attempted to infiltrate the online conversation and tarnish the pro-repeal campaign. Operation Zyklon encouraged users to spread awareness of a connection between Amnesty International Ireland and the philanthropist George Soros, who donated €137,000 to Amnesty’s My Body My Rights campaign in 2016. Operation Trojan Horse saw users sharing templates of fake pro-repeal posters with extreme captions such as, “There should be no limit on abortion up to birth”. Users were encouraged to print and spread these posters around college campuses and share them across social media. A particularly curious operation called Operation Drunken Monkey aimed to stifle student voter turnout by organizing club nights on May 24 in the hope that students would be too hungover to vote the following day.
(tags: 4chan repealthe8th abortion referenda politics fake-news amnesty)
How Ireland Beat Dark Ads – Foreign Policy
In practice, while these recognizable attempts to disrupt the democratic debate with microtargeted ads, bot activity, and misinformation were active, they appear to have been relatively ineffective and may even have turned voters away from those employing them. Given the battleground online discourse has become in democracies across the world, this small country’s resistance to it may offer some cause for hope. The resilience offered by the small size and close-knit nature of the Irish electorate may be difficult to reproduce in larger democracies. But the active measures taken by media, volunteer groups, and campaigners against potentially corrosive techniques can be a powerful inspiration.
+1 -- it's heartening that we were able to defeat these 21st century dirty tricks after the damage they did with Trump and Brexit.(tags: brexit elections trump fake-news propaganda bots dark-ads facebook social-media repealthe8th referenda abortion ireland repeal-shield twitter)
‘Abroad For Yes' Helped Irish Voters Get Home for Abortion Referendum
This was one of the most amazing things I saw during the referendum campaign, alright! I had the pleasure of helping to fund several journeys home to vote:
Rebecca Wilson, one of the Abroad for Yes co-founders, said she and two other women, her sister Lauren Wilson and Hannah McNulty Madden, decided to launch the group when the referendum date was announced in late March. Wilson was visiting Helsinki, where Lauren and McNulty Madden are students. After realizing Lauren and McNulty Madden weren’t eligible for a postal vote, they looked up the cost of flights and panicked. On Twitter, however, McNulty Madden noticed that people were expressing interest in helping people who wanted to go home to Ireland but couldn’t afford it. The women decided to set up the Abroad for Yes Facebook group as a community for supporters of repealing the eighth amendment to gather and find one another. Wilson thought they’d help fund travel for maybe 10 people total, but in the first day of the group’s existence funded 5 trips, including for Lauren and McNulty Madden. After traveling back to Dublin, Wilson and the group continued to help others, enlisting three other group administrators. Wilson said they don’t have an exact figure, but she believes they’ve helped raise at least 30,000 euros.
(tags: ireland repealthe8th abortion referenda abroad-for-yes t4y facebook)