2009-08-05 04:51:43
By Gordon Corera
BBC Security Correspondent
The world of espionage lies at the heart of the mythology of the Cold War.
Along with nuclear weapons, spies were the emblems of the conflict.
But while the tales of adventure, betrayal and mole hunts have proved a source of rich inspiration for thriller writers, did they actually make a difference to the outcome?
Did intelligence make the Cold War hotter or colder?
It is difficult to know the answer.
"There were secrets that were important to keep secret and there was intelligence which it would be very helpful to have known," argues former British Foreign Secretary David Owen.
"But my own instinct is that we didn't really - with a few exceptions and a few important exceptions - really know exactly what was going on."
One reason it is hard to make a judgement is that much of the intelligence collected was military or tactical in nature, and would only have proven useful if the Cold War had gone hot.
Much effort was expended in stealing secrets like the Soviet order of battle or the design of new Soviet tanks which would have been invaluable in case of war.
. Intelligence during the Cold War had a very big impact on the shape and size of the British defence programme .
Sir David Omand Former UK Intelligence and Security Coordinator
This type of intelligence was collected by electronic means and satellite reconnaissance, as well as by human spies. It was used to work out how to best equip and prepare the military.
Sir David Omand, the former UK Intelligence and Security Coordinator, says: "Intelligence during the Cold War had a very big impact on the shape and size of the British defence programme, on the kinds of equipment we bought and very specifically the actual capabilities that were built into that equipment to be able to encounter whatever intelligence showed was the capability of Warsaw Pact forces."
During times of "hot war", intelligence plays an important but ultimately secondary role in supporting military operations.
But, during periods of tension short of full-scale military action like the Cold War, intelligence takes on a more central position.
In the absence of traditional warfare, intelligence becomes itself the primary battleground as each side tries to understand the enemy's capabilities and intentions, as it seeks to undermine their position using covert action, psychological operations and forms of subversion.
Britain's Secret Intelligence Service (SIS or MI6) had a troubled beginning to the Cold War, not least because it was penetrated by its Soviet counterpart, with men like Kim Philby and George Blake handing over secrets.
But slowly it became more professional, recruiting and running agents who could provide information on the activities of the Soviet bloc.
Intelligence sceptic
Some former diplomats query the record of intelligence in providing insight into political trends.
Rodric Braithwaite, a former ambassador to Russia at the end of the Cold War and later Chair of the Joint Intelligence Committee, is something of an intelligence sceptic.
"I was always rather encouraged by the Joint Intelligence Committee, who used to send us drafts of their assessments on Soviet affairs with the secret bits cut out because they didn't want to have them sloshing about in Moscow.
"With the secret bits out, the conclusions they were coming to were exactly the same ones that we were coming to in Moscow because the information that mattered was available at both ends and it was mostly either conversations with people, which were not particularly secret, or what was in the newspapers."
But Sir Gerry Warner, a former deputy chief of MI6, believes intelligence helped ensure politicians had a realistic understanding of what the Soviet Union was up to.
"It is always a temptation if somebody is saying 'I am a friend of yours and I don't mean any harm' to accept that.
"But if you are being told all the time by a microphone in your ear that it is totally untrue and that he's holding a knife behind his back, he's about to kick you where it hurts, the temptation is less to trust him."
Running agents behind the Iron Curtain involved risk - risk to the life of an agent but also politically in terms of raising the temperature.
"The main concern was always balancing the value of possible intelligence against the risk," explains Sir Gerry Warner.
"If an espionage operation was uncovered it was always an important public event - the media got into it, the other side would play it up - and therefore there was a political risk clearly."
Understanding intentions
Spy rows flared periodically. In the early 1970s, the UK expelled more than 100 Soviet diplomats from its embassy in London.
So did these kind of operations and activities fuel distrust and paranoia?
The identity of most agents remains secret but a few have become public and one or two of those can be claimed to have made a real impact.
One was Oleg Penkovsky, a colonel in Soviet military intelligence.
. Knowing your enemy is very important indeed .
Baroness Daphne Park Former MI6 controller
His information - passed to MI6 and the CIA in the early 1960s - helped President Kennedy manage the Cuban missile crisis successfully by identifying the extent of Soviet missile capability and how far the Soviet leader Nikita Kruschev was likely to push events.
The most useful strategic intelligence comes from penetrating the leadership of your enemy so that you understand not just their military capability but their intentions.
That was something MI6 only managed late in the Cold War largely thanks to KGB Colonel Oleg Gordievsky, who spent a decade towards the end of the Cold War supplying intelligence to MI6 which revealed how paranoid the Soviet leadership was of a first nuclear strike by Nato.
"The British service could not believe it but because I proved it very well they eventually believed it," he said.
"Knowing your enemy is very important indeed," argues Baroness Daphne Park, a former MI6 controller.
"It was very important that we should know that they were as paranoid as that. I don't see how we would have known it any other way."
Col Gordievsky's insights had a profound effect on both Margaret Thatcher and Ronald Reagan in rethinking how they approached the Soviet Union, which in turn helped them manage the end of the Cold War.
"What nobody wanted was to be surprised," Sir John Scarlett, the chief of MI6, told me in his office.
"And that intelligence knowledge, intelligence base if you like, gave knowledge which greatly reduced that fear of a surprise attack.
"And, as the Cold War developed, more confidence developed that the other side was understood, and that helped manage the situation and was a key reason why we got to the end without a blowout."
The one thing the spies failed to predict, along with everyone else, was of course the end of the Cold War itself.