Skip to main content

Will the AI Copy Editor Be the Master or the Assistant?

Tuesday’s news about Harry Potter getting the AI treatment reminded me of a similar story from last week.

Last week Wired published an SF story that was not so much written by an AI as it was written under an AI’s editorial oversight (the kind of writing assistance I expect all writers will have one day).

The AI was developed by University of Toronto professor Adam Hammond (English) and Dr Julian Brooke (CS PhD), and was used by SF author Stephen Marche to write a new story in the style of several of his favorite authors. Marche selected the works he wanted to emulate. Brooke and Hammond then analyzed the stories and came up with a list of 14 stylistic rules to guide the writing process, and:

Hammond and Brooke created a web-based interface through which their algorithm, called SciFiQ, could tell me, on the textual equivalent of the atomic level, how closely every single detail of my writing matched the details in my 50 favorite works. (I’m talking “nouns per 100 words” level.) When I typed in a word or phrase and it was more than a little different than what SciFiQ had in mind, the interface would light up red or purple. When I fixed the offending word or phrase, the interface would turn green.

The key, obviously, was the texts that I selected: “Vaster than Empires and More Slow” by Ursula K. Le Guin, “The Father-Thing” by Philip K. Dick, “There Will Come Soft Rains” by Ray Bradbury—I can’t list them all, but you get the idea. I wanted to write something incredible, so I picked stories I thought were incredible. Whether that’s what I got might be another story.

You can read the story over at Wired. It isn’t very good; it was shown to two experts in a blind test, and they thought it was "Full of unnecessary detail, wooden, implausible dialog ".

What I found most interesting about this story is how the writing process parallels any other act of writing. Marche had rules to follow, and like an English teacher the AI dinged his writing whenever he departed from the rules.

In the same way that knowing when to ignore writing rules can lead to a better story, this marginal story could have been improved if Marche had identified when he could ignore the AI’s rules and write what he felt the story needed.

We’re still a few years away from this type of writing tool being on everyone’s desk, but it’s not too early to remind us all that this is a tool used by writers, not their replacement or their boss.

Similar Articles


Tom Wood December 14, 2017 um 5:03 pm

I recently purchased ProWritingAid during their cyber Monday event. I got confused about whether I’d downloaded the correct desktop version because it still requires an internet connection. When I asked their help desk, they assured me I had the right version. They also said this:

"As deep text analysis requires lots of resources (more than 50 Gbs of data), we had to move toward a cloud-based solution. So we need access to the Internet to give you advanced reports."

Which means that PWA is already a type of AI assisted editor. The level of detail in the analysis is really amazing. (No affiliation or financial interest in PWA, and I am not a robot!)

Nate Hoffelder December 14, 2017 um 6:57 pm

Okay, so ProWritingAid is about halfway to an AI copy editor.


Write a Comment