Significant things that came out of this interview:

1. Bannon names names, listing the people in the State and Defense Departments that he is actively trying to oust.

2. On a military option against North Korea:

There’s no military solution [to North Korea’s nuclear threats], forget it. Until somebody solves the part of the equation that shows me that ten million people in Seoul don’t die in the first 30 minutes from conventional weapons, I don’t know what you’re talking about, there’s no military solution here, they got us.

3. On white supremacists (that he's helped to stir up):

Ethno-nationalism—it's losers. It's a fringe element. I think the media plays it up too much, and we gotta help crush it, you know, uh, help crush it more. These guys are a collection of clowns.

4. Coda to the above, he said (accurately IMO) that the more Democrats harp on identity politics, the more elections they'll lose.

The Democrats, the longer they talk about identity politics, I got ’em. I want them to talk about racism every day. If the left is focused on race and identity, and we go with economic nationalism, we can crush the Democrats.

5. His biggest foreign policy concern is trade with China.

We’re at economic war with China. It’s in all their literature. They’re not shy about saying what they’re doing. One of us is going to be a hegemon in 25 or 30 years and it’s gonna be them if we go down this path. On Korea, they’re just tapping us along. It’s just a sideshow.

According to one source, Bannon told people that he didn't think he was giving an interview (but he never claimed to ask the reporter to keep anything off the record). There was also, apparently, some puzzlement about why he would call a reporter for The American Prospect, which is about as hostile to Trump as you can get without being Daily Kos.

This same article suggests that a lot of erstwhile allies of Bannon are none too pleased about this. One of them is quoted as saying:

Since Steve apparently enjoys casually undermining U.S. national security, I'll put this in terms he'll understand: This is DEFCON 1-level bad.

. . .

There're two obvious scenarios, and I'm not convinced they're actually mutually exclusive. The first is that this is a matter of Trump's inability to manage the people around him, and Bannon continuing to operate as if he's in charge. It's also possible that it's part of some broader strategy, although whose it is and what any kind of end goal may be aren't clear.

edit to add: Here's why I think it's the former. Bannon has long been trying to be the man in charge, from having himself assigned to the NSC to trying to oust Reince Preibus (and, apparently others). And notice how he words some things: in his quote on military action against North Korea, he talks about how there's no plan unless someone can show him how to avoid significant civilian deaths in Seoul. Not "us," not "the President."

The other thing the article mentions is that Bannon claims to be trying to get a bipartisan consensus on China being a threat economically. Maybe by reaching out to a left-leaning reporter, he's trying to make it easier for Democrats to work with him? This fits if, again, he seems himself as actually in charge (or at least is trying to be). This is especially interesting as the Republican Party leadership is increasingly deserting Trump. Bannon's become increasingly isolated in the White House, and the Republican leadership in Congress is increasingly deserting Trump. Maybe Bannon's decided to turn his isolation to his advantage and be the last man standing?