Machine Learning Enlightenment
As somebody who works in technology but is not really a programmer, I’ve been in a weird spot with machine learning. It’s obviously interesting and powerful, but I’ve never tried to do anything with it. Sometimes clients ask about it, but our work projects have never been great fits for it, despite the nice buzzword appeal.
But! I finally dipped my toe into this via RunwayML, a more consumer-friendly wrapper for Machine Learning projects, that bills itself as ML for Creatives. I downloaded it a few months back and just now got around to messing with it. Reader: HOLY CATS, it is fun.
Now, a disclaimer: I am really only dipping a toe here. This is very much ‘kindergarten-level’ machine learning, but still: FUN. Adam was right.
There was real learning curve, and I had to watch several tutorials to even understand what the interface was supposed to do. But within a couple of hours I had trained a GPT-2 model on Thomas Traherne’s Centuries of Meditations, which is a series of short devotional paragraphs from a priest / poet in the 1600s.
I actually find this book deeply meaningful. I have given copies to people, I once started a tumblr and twitter account to repost the meditations one at a time. In short: it’s a personal favorite. But it’s got a very singular style, and is made of these short defined units of text, that it seems ready for parody (and therefore machine generation?). The content of the meditations is also very consistent: Traherne’s big thesis is Extreme Optimism: it is easy and delightful to exist in the world, if you attune yourself to the inherit goodness of the created universe.
So.
I gave the thing the original text, set a super-low training cycle, and it’s just: good enough already, in like 15 minutes. After the model is trained, you give the system a text prompt and a desired length of output. It generates a number of attempts at completion.
There are hundreds, thousands, an infinite amount of new texts that are already indistinguishable from real Traherne. Lots that descend into gibberish, but lots that are… pretty good.
Examples
Here are some examples of real Traherne, from Centuries of Meditations.
Real Traherne:
Is it not easy to conceive the World in your Mind? To think the Heavens fair? The Sun Glorious? The Earth fruitful? The Air Pleasant? The Sea Profitable? And the Giver bountiful? Yet these are the things which it is difficult to retain. For could we always be sensible of their use and value, we should be always delighted with their wealth and glory.
Real Traherne:
Yet further, you never enjoy the world aright, till you so love the beauty of enjoying it, that you are covetous and earnest to persuade others to enjoy it. And so perfectly hate the abominable corruption of men in despising it, that you had rather suffer the flames of Hell than willingly be guilty of their error…
And here are some Machine-generated Traherne. In this attempt, I started it with the phrase ‘I have found’
Machine Traherne:
I have found that in all worlds the Laws of Nature are the best that shall be. Had men been made amiable by the desire of the Soul, they would have been made guilty of covetousness. The Laws of Nature contain the power of Loving, Imitating, Contemplate, and Loving. It giveth pleasure to the Soul that enjoys it, and delighteth in the Creature more than He is.
Machine Traherne:
I have found that the Sea of Joy is the end of all Happiness! Is not that because of its endlessness endless? Well, that the Sun and stars are the gates of Happiness, that your soul may be filled with Delights, Honour and Peace! But it is because God dwelleth in seeing them. And here His love hath made this place aflame: which it hath done with all His love: in making it open into many hosts: and manifesting Himself to innumerable other enjoyments.
Yes, there are some that just get stuck in a kind of probability loop, and repeat a phrase over and over.
I have found by the very things that are in Him that are in Him that are in Him that are in Him that are in Him that are in Him that are in Him that are in Him that are in Him that are in Him [ed. I just cut twenty lines of that] that are in Him that are in Him tha (saith of the Lord this Sunday) being fulfilled
And some that are absurd enough to delight.
I have found that the In-laws are conspiring to seduce you, seduce you with lies and trick you into insatiable love and devouring you: to make you to despise them, and to see you impure and enslave you.
The original text is also so old-fashioned with long complicated grammar, that it’s easy to get lost in a sentence - which makes it a pretty good match to how the GPT-2 sentences spin out. If the grammar falls apart towards the end of a long sentence, my brain immediately draws the conclusion that it was me, the reader, who misunderstood this. I think this charitable stance towards older authors helps the machine-generated version get an easier pass here.
This whole exercise is just so FULL of potential. I want to spin up a ‘lost Traherne manuscript discovered in dusty attic’ scam or something.
But wait
A weird, unexpected follow-on here: some of this machine-generated text was… kind of meaningful? I found there are real moments of poetry and insight in these. Several times I stopped and thought: huh, yes, that’s true.
Maybe that’s not surprising? Look, I fed a machine 500 mini-sermons that I find pretty resonant, and it spit out mini-sermons that I still find pretty resonant. But they were written by a machine! Five minutes ago!
My initial reaction was to say, ‘haha, nothing a computer generates actually means anything’, and of course, that’s true in the sense that there is no authorial intent. The author here didn’t mean anything by this text. GPT-2 simply spits out text that is statistically likely to match the model of the training text.
But… what does it matter to me if a paragraph-length sermon came from a guy who lived 450 years ago, or a computer five minutes ago? There’s a different level of experience that happens simply between ME and the TEXT. If I find some revelation via real or fake Traherne, does there need to be any difference?
And if I accept that proposal, am I just one step from the kind of person who is into horoscopes and fortune cookies and looks for ‘signs’ in the world? I don’t know.
There is presumably a whole field of art criticism or literary study devoted to this question, cf elephant-made paintings or Dada in general. But man! It was really fun to experience this dilemma directly, and self-inflicted at that.
(pictured: the Traherne windows at Hereford Cathedral)
Arizona 2020
We went to Arizona for spring break! As usual, I’m marking down an overview of the trip because I have a terrible memory and need to write things down in order to remember them.
Felix is in fourth grade, and with his ‘Every Kid in a Park’ free pass to all National Parks, Lands, and Waters, we asked him to pick a National Park he’d like to see. He chose Grand Canyon*.
So: we combined this with Erika’s dream to try out that #vanlife. We flew into Phoenix, and rented a camper van. It was fun.
The whole trip was very weird with the coronavirus shit hitting the fan in the US, because we were in an international tourist destination but also camping without cell service or wifi. We’d drift into cell service, my phone would blow up with ominous news, and then we’d go back to the woods. I definitely had some small but nonzero worry that they wouldn’t let us back on a plane to get home.
Here’s the itinerary:
We stopped in Phoenix one night to visit my cousin (and had a great time), then drove up to the Canyon and camped for three nights.
I’d been once before about twelve years ago, and if anything it was more impressive than I remembered.
On Monday we did our big hike, which was just 3 miles down and back on the Bright Angel trail. That was fun, and the kids did great. It made me want to plan out a much longer hike.
One weird highlight: seeing an air rescue. Somebody fell on the icy part of the trail, and had to get choppered out of the canyon. It looked terrifying to get strapped to a stretcher and then dangled 50 feet below a helicopter OVER THE GRAND CANYON.
The next day we woke to heavy snow and clouds, which was beautiful and also made for interesting canyon views.
The cloud cleared enough that we got to see a tiny slice of the sunset knife into the canyon at a super low angle; it was really beautiful.
We packed up after three nights and headed south; we pulled over at Kaibab National Forest Campground because Trudy was feeling carsick, but it was unexpectedly a gorgeous park with literally nobody around; we stopped and cooked breakfast by the lake.
Then we spent lunchtime in Flagstaff, and spent the afternoon driving south on a scenic route thru the Coconino National Forest and the Tonto National Forest (State route 3 thru Happy Jack, 67 to Strawberry and Pine, then 87 south). This was a surprisingly pretty drive, through much more elevation and forest than I expected. There were a dozen places we wished we could have explored or camped at, esp Saguaro Lake. Apparently there has been a ton of rain lately, and everywhere was blooming with greenery and wildflowers.
We did camp at Lost Dutchman state park, (pictured at top), and that was another beautiful spot I didn’t expect. Arizona really has four new converts - there was so much more than desert to be seen, and it was all so interesting. Then again, we probably love anywhere when it’s 45 degrees and rainy. We probably would hate anywhere that’s 95 degrees and sunny.
Our last day was back in Phoenix: returning the van, lunch with my cousin again, and hanging out with our friend Richard, up from his retirement location in southern Arizona.
The verdict: America, man!
*Turns out: everybody says The Grand Canyon, but at the park it’s only Grand Canyon, no definite article required.
Tilman Meet World
One of the big objectives of my trip in Germany last spring was to visit the works of Tilman Riemenschneider, the late medieval sculptor. This was research for a new site project I was working on through 2019 - something to catalog his work in better detail, and provide a resource for anyone that wants to learn more about his work.
I’ve loved Tilman Riemenschneider since I first saw a piece of his in Lawrence, KS at the Spencer Museum of Art. They have a really striking Madonna and Child figure - sensitively carved but with a bit of the medieval stylization used for religious figures. I love this historic moment in art history, when artists can create true-to-live realism in their portraiture, but choose not to because of who and what they are depicting. I think this lends a weird sense of modernity to the enterprise, actually; there’s just a bit of anime exaggeration in the figures.
So anyway, I’ve made it a goal to see as many extant Riemenschneider pieces in person, and of course as I did this, I wanted to create a better resource for others. Thus: the new TilmanRiemenschneider.com.
I’ve also learned how to spell Riemenschneider correctly, about 85% of the time.
2019 Recap
Every year I write a wrap-up post, not because I think anybody cares, but instead because I have come to cherish the exercise of looking back at what happens in a year. I’ve learned that I either have a terrible memory, or am just very future-focused. I hardly ever look backwards to appreciate all this fun stuff, unless I take some dedicated time to do it.
That said, here’s some stuff that happened in 2019.
TRAVEL
Whew, we are getting awfully used to a lifestyle full of travel. It doesn’t even feel like we traveled a lot this year, but we were out the door almost every month in 2019.
- FEB: Matt to SF and Oakland in february
- MAR: Matt to France in March for work, Germany after that for pleasure. recap here!
- APR: San Diego in April
- JUNE: STL in June, and Mellie was there for some of it!
- JUL: Tulsa in july (it was hot)
- JUL: Erika 20-yr High School Reunion in July
- AUG: kids weekend in STL with my parents in Aug
- SEP: Erika took a long road trip to Seattle and BC
- OCT: San Francisco in Oct for Will wedding / biz meetings / family hangout
- NOV: Thanksgiving in Chicago (we even stopped for lunch in Iowa to see my friend Qing)
- DEC: STL for Christmas
VISITS
And lots of people came to visit last year!
- Lewises visit for NYE (2018)
- Phil & Rel in december!
- Heidi and girls visited in the spring
- Pat visited
- our college friend crew visited in July for a week
- Lillers again in November
- Elkes in Dec/Jan
HOUSE STUFF
The chores of homeownership are generally tedious and frustrating, but this sadly takes up a big amount of brainspace and effort - so I definitely include it in my recap of the year. Plus, it’s nice to look back at the things we learned how to do (or not do).
- The big one last year: Erika finished the house next door for her mom, and Carola moved in! Erika did an incredible job. I barely helped at all, which was great. I built some steps and a porch.
- We had some further roof fixes done
- We got backup sump pumps down in the basement after a minor power outage proved just how short a time it takes to get water in the basement
- We replaced the water heater, ie, a plumber did it for us
- Erika and I actually poured a new crown for our chimney!
- Erika and I reframed out our four skylights, which we discovered were NOT EVEN ATTACHED TO THE HOUSE, just sitting in place on the box.
CREATIVE PURSUITS
- Took an amazing puppet class, made amazing puppets
- Made a big Tolstoy head and other halloween costumes
- Redesigned and relaunched TilmanRiemenschneider.com, my ongoing catalog of the german sculptor.
- Baijiu Review ticked along, got to try some delicious stuff, got some neat bottles contributed, and hosted a couple of tasting nights.
- Erika did a great project halfway thru the year where she visited the same site in a big park every week. But then the flooding cut off that site, so she couldn’t go there any more.
- Printed the last 4 Charles Williams novels! Finishing that project was almost on autopilot, but it was a big achievement and it’s great to have that wrapped up. Now I just need to sell some more books. (available here for sale!)
- Dumb Cuneiform is still going, and I’m still making custom clay cuneiform tablets based on your dumb tweets.
- Made those concrete molded finials
- Made a fun card game w the kids
- Designed a set of tarot cards for sean’s video
KS
Interesting weather this year, which made it really nice to be in Kansas. We got a bunch of snow in the winter, a TON of rain in the spring, summer was hot but in a nice way, and autumn was GORGEOUS.
COMMUNITY
- I continued as a trustee at church, switching to the ‘lead’ trustee for 2020.
- Erika started the year in her board position at SSL. Then over the summer, they convinced her to take a new position as Donations Manager, which she’s doing amazing at. She still put on the big annual dress giveaway in her volunteer capacity, anyway.
- My friend Qing left lawrence :(
- Felix and I worked on a construction project at church, rebuilding the wheelchair ramp
- Matt joined a crossfit gym, which takes up SO MUCH TIME.
FAMILY
Felix and Trudy are just as delightful as ever. Felix started a new classroom at school, with the 4-6 graders. Trudy is now at the boss-level of her 1-3 class. A big change for last year was our new neighbor: Erika’s mom! It’s really nice to have her next door, and I enjoy having her in family activities like our birthday breakfasts, etc.
- Trudy colonized a jewelry class at the art center, and continues to just CHURN out the artwork at an inspiring pace.
- Felix upgraded soccer levels again, and his Premier league has two practices per week plus weekend games in KC. It’s an increase in our time commitment, but the games are FUN.
- They both went to real summer camp this year, and loved it.
WORK
Work at Brand New Box was really fulfilling this year. Challenging, rewarding, and with an eye for building big things in the future. I’m excited. I’ll write a year-end wrap-up over at brandnewbox.com as well, but some highlights:
- josh had a baby!
- mark left!
- major EOS revamp!
- team went to Colorado!
- will got married!
- rosetta was a hit!
- joe joined!
- several new clients signed on!
2020
I have high hopes for 2020. But this recap exercise really convinces me of one thing: I am one lucky bastard.
Animated Eyes
If you know me a little, you know this is Extremely My Jam.
Designer Dinaa Amin made this stop-motion video of plastic eyes, gathered from discarded/salvaged doll heads. As someone who is still a little obsessed with the robots lurking inside children’s toys*, I’m a fan.
Here’s the video:
*Also! I’m reviving this project a bit, because now Erika works at a thrift store and she has been finding some amazing toys to work with.