'You’re reading my mind': GitHub's AI coder amazes (and terrifies) developers

Will Copilot make it into every developer’s toolkit?

A diagram explaining how Copilot works.

Copilot, built with OpenAI’s Codex tool and Microsoft-owned GitHub’s monstrous code database, launched in late June.

Image: GitHub

Tech consultant Ady Ngom laughed nervously. A tool called Github Copilot had just anticipated the exact function he wanted to type: The AI helped him write the classic Fibonacci function. Now, he wanted to speed it up using memoization. Copilot, which Ngom had installed only moments before, was one step ahead of him. “Can it listen to what I’m saying? Maybe that’s how it got it,” Ngom joked on a November LinkedIn live broadcast, where he was chatting about Copilot with some other developers.

“I was like, holy moly, you are just reading my mind right now,” Ngom told Protocol. “It was a surreal moment.”

Copilot, built with OpenAI’s Codex tool and Microsoft-owned GitHub’s monstrous code database, has stunned coders far and wide since its technical preview launch in late June of last year. Search #GitHubCopilot on Twitter and you’ll see software developers have had similarly amazing, yet somewhat jarring experiences. “Github #Copilot is so useful that it scares me at times,” one user tweeted. “I am truly amazed by the potential and craziness of #GitHubCopilot. I mean it seriously is crazy,” said another. Right now, Copilot is available only to individual developers who sign up.

Described as “your AI pair programmer,” Copilot recommends lines or blocks of code right in your editor. It can autocomplete repetitive code, offer lists of potential solutions and turn comments into code. It’s not perfect; France-based UI engineer Ivan Galiatin said sometimes it can feel like coding with a child. But in the six months since its launch, Copilot’s usefulness and power is clear. GitHub says Copilot’s suggestions make up more than 35% of newly written code in languages like Java and Python.

Any new technology that automates a significant chunk of work will always be both amazing and scary. The Copilot team hears the “amazed and scared” reactions loud and clear. Greg Brockman, co-founder and CTO of OpenAI, told Protocol, “We want to maximize the reasons to be amazed and minimize the reasons to be scared.”

Copilot prompts questions about the future of education, labor and creativity within the computer science world. The debates will only get fiercer if Copilot makes its way to the workplace.

“We see many people clamoring for it,” said Oege de Moor, the GitHub VP overseeing Copilot. “Just imagine, you’re leading a large organization and you hear about 35% of the code could be written. That’s really a big win.”

How Copilot works

AI code completion isn’t new. Plenty of developers use tools like code predictors Tabnine and Kite. But Copilot stands out because of the companies behind it. GitHub hosts the work of 73 million developers: an incredible wealth of information on which Copilot can train. Combine this with Microsoft’s reach and OpenAI’s comprehensive AI research, and it’s hard to fail.

“One thing that’s very convenient about building a product like this is you can really dogfood it internally,” said Brockman. “Dogfooding”(encouraging engineers to use the software they make) helps identify flaws. The teams at OpenAI and GitHub are intimately familiar with coding frustrations and technicalities, which made it easier to evaluate Copilot as they built it.

The goal is to replace the boring part of coding. Instead of going to Stack Overflow or Quora or Google to find a basic coding solution, Copilot grabs it for you. You press tab to accept the suggestion, or keep typing to ignore. “I can delegate some tasks that I just don’t want to do,” Galiatin said. “It saves a lot of mental energy and a lot of time.”

“The part that always gets me is how quickly it adapts to your style of coding, instead of imposing on you a way of coding,” Ngom said. It won’t make you a better coder, Ngom said. But it will make you faster. “It says, 'How can I facilitate your thinking process?' rather than, 'How can I take away your thinking process and just give you code?'”

Training new coders

De Moor hopes Copilot draws more people to the coding profession, helping tech companies tackle the industrywide recruitment problem. Highly skilled developers can offload grunt work and solve more interesting problems. Beginners or low-skilled developers can use Copilot as a jumping-off point.

“People who are not yet proficient in a programming language or who do not have the benefit of a computer science education, this will help them get started much more quickly,” de Moor said.

Not everyone agrees that Copilot is good for beginners. “I mentor junior developers and I tell them to stay away from Copilot,” Ngom said. “It is very important to get a solid understanding of programming and coding practice first.” Some developers are fearful of Copilot undermining computer science education, teaching students to use it as a crutch throughout their careers.

Copilot makes sense for intermediate and advanced developers, Ngom said. “I don’t have any problem with copy and pasting, as long as you understand what you’re copy and pasting.”

But Brockman thinks AI-powered tools like Copilot could be a real “democratizing force” in computer science education. He referenced a handy experimental feature that explains strings of code in plain language. “You can have this personalized code tutor that is just for you and able to give you the feedback and instruction you need,” Brockman said.

Copilot in the workplace: Is it a developer tool or is it a developer?

An obvious concern is Copilot squashing originality. Then there’s the existential concern of Copilot replacing developers altogether. The World Economic Forum predicted that AI will replace 85 million jobs worldwide by 2025 — though it also says it will create 97 million jobs at the same time.

Though some are concerned about AI taking their jobs, the developers Protocol spoke to are not. At least, not yet. Copilot is no match for human intuition, and developers’ jobs extend beyond writing code. De Moor and Brockman, as expected, pushed back on concerns as well.

“The truly creative part of coding is deciding what the software should do,” de Moor said. “I don’t foresee a future where Copilot produces useful code without human input. I do see unbridled human creativity no longer held back by irrelevant details.”

“I actually think what we’re seeing is AI taking no jobs, but taking the drudge work from all jobs in unison,” Brockman said. “We have these tools that just enhance what people can do.”

Right now, these conversations are hypothetical. Copilot isn’t in the workplace yet. Enterprises are still working through how to use AI generally, and Copilot has to clear some specific hurdles.

For one, using a tool trained on public code to create commercial products is ethically and legally ambiguous. That debate is still evolving. There are also ethical questions about code reproduction. GitHub is working on a filter to eliminate Copilot suggestions that are carbon copies of code in GitHub’s repository. De Moor said this doesn’t happen often. And if it does, it’s usually because there’s only one way to write the code. But he doesn’t want users “to be worried that you might unwittingly infringe an open-source license by using Copilot.”

Suman Hansada, an India-based SaaS engineer, has been using Copilot for personal projects but can’t use it in his job. Copilot, and by extension GitHub and Microsoft, learns from its users’ code. That’s a no-go for companies reliant on customers paying for their code. “Your company can have proprietary code that they don’t want to be in the public domain,” Hansada said.

Still, as Copilot and OpenAI’s Codex improve, Brockman thinks workplace adoption is imminent. “You multiply the productivity benefits across all your developers,” he said. “I think we’re gonna see these tools at every developer’s desk.”


Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.


Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories