Security Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Security Magazine logo
  • NEWS
    • Security Newswire
    • Technologies & Solutions
  • MANAGEMENT
    • Leadership Management
    • Enterprise Services
    • Security Education & Training
    • Logical Security
    • Security & Business Resilience
    • Profiles in Excellence
  • PHYSICAL
    • Access Management
    • Fire & Life Safety
    • Identity Management
    • Physical Security
    • Video Surveillance
    • Case Studies (Physical)
  • CYBER
    • Cybersecurity News
    • More
  • BLOG
  • COLUMNS
    • Career Intelligence
    • Cyber Tactics
    • Cybersecurity Education & Training
    • Leadership & Management
    • Security Talk
  • EXCLUSIVES
    • Annual Guarding Report
    • Most Influential People in Security
    • The Security Benchmark Report
    • Top Guard and Security Officer Companies
    • Top Cybersecurity Leaders
    • Women in Security
  • SECTORS
    • Arenas / Stadiums / Leagues / Entertainment
    • Banking/Finance/Insurance
    • Construction, Real Estate, Property Management
    • Education: K-12
    • Education: University
    • Government: Federal, State and Local
    • Hospitality & Casinos
    • Hospitals & Medical Centers
    • Infrastructure:Electric,Gas & Water
    • Ports: Sea, Land, & Air
    • Retail/Restaurants/Convenience
    • Transportation/Logistics/Supply Chain/Distribution/ Warehousing
  • EVENTS
    • Industry Events
    • Webinars
    • Solutions by Sector
    • Security 500 Conference
  • MEDIA
    • Interactive Spotlight
    • Photo Galleries
    • Podcasts
    • Polls
    • Videos
      • Cybersecurity & Geopolitical Discussion
      • Ask Me Anything (AMA) Series
  • MORE
    • Call for Entries
    • Classifieds & Job Listings
    • Continuing Education
    • Newsletter
    • Sponsor Insights
    • Store
    • White Papers
  • EMAG
    • eMagazine
    • This Month's Content
    • Advertise
  • SIGN UP!
Security Enterprise Services

How to Sort through Big Data for Threat Detection

By Vince Walden
June 11, 2013

 

fraud1
Image courtesy of Ernst & Young.

In the age of Big Data where volume, velocity and variety of data is increasing complexity both internally and externally, integrating new data sources is bringing organizations tremendous opportunities to mitigate threats in new, innovative ways.

Scanning through news articles, there is a steady proliferation of headlines on fraud, corruption and espionage. Whether it’s a rogue trader in London, U.S. companies bribing government officials for permits in Latin America, or a foreign government’s cyber army pursuing target U.S. companies, great attention has been paid to developing sophisticated countermeasures. Companies now have forensic accountants and ex-hackers on payroll, and many governments have law enforcement and military divisions dedicated to fighting corruption and wars in cyber space.

Looking inward

It is easy to label corrupt governments and external hackers as the enemy. However, often coworkers that you trust and see every day can be the ones committing fraud, sabotage and espionage, from the inside. Internal controls have moved mountains since SOX (Sarbanes-Oxley), but as recent financial industry failures have proved, these can be defeated. Firewalls keep unwanted visitors out, but as WikiLeaks demonstrated, insiders regularly steal valuable sensitive information.

Numerous studies and recent history show these insider events are not isolated incidents. How can organizations proactively identify risk of insider incidents while maintaining the balance between vigilance and privacy?

Data Overload

Fortunately (and unfortunately), we live in an age surrounded by data that is growing exponentially. According to Gartner, only eight percent of information generated actually gets analyzed. We can now look at the thorny issue of insider threats proactively from a more behavioral perspective rather than dealing with the problem reactively(a.k.a. too late). This doesn’t mean blindly buying into the buzz around big data, but rather making sure that informed context and actionable insights can be developed from the intersection of data and analytics. With terms like petabytes, Hadoop and predictive modeling, this process can easily become overwhelming. The key is to be focused, keep the results simple, and never forget to ask “so what?”

Concealed constructs of insider events mean direct proofs are inevitably difficult to find. But that doesn’t mean insiders are immune to behavioral changes – physical and psychological – often associated with clandestine activities. Detecting these changes has long been a favorite tactic for the law enforcement and intelligence agencies.

Explosive growth in communications, sensor, social and other varieties of data that permeate the corporate world today offers a cost effective opportunity to monitor for these subtle and gradual behavioral changes as a significant risk factor to information assurance.

Focusing outside of the box

Take emails and instant messages. We can now apply advanced linguistic analysis with relative ease to identify changes in underlying emotive tones. One of the most famous case studies of this exercise is the mapping of emotive tones on emails by Enron executives at around the time of its infamous collapse. Starting in October 2000, the volume of “derogatory” and “confused” emails began to increase dramatically and spiked in October of 2001, coinciding with the timing of the financial scandal.

Sensor data, such as badge readers and biometric scanners, is another great source to look for changes in behaviors. In near real time, we can apply quantitative algorithms on billions of records to identify patterns that significantly differ (in a stochastic sense of that word) from normal. For example, abnormally concentrated badge swipes through a sensitive research facility right after the annual performance review may warrant closer scrutiny. That, when combined with an individual’s time reporting information, email communications or sales activity can now come together to paint a more complete risk profile.

Multiply the number of information sources (accounting, travel, social media, etc.) and increase the volume, and one can easily see this application of big data analytics forms a rational framework to detecting the risks of insider threats. In a hyper-connected global economy, fraud and espionageis not only lucrative, but can sometimes be a competitive practice, especially in emerging markets. Companies need to be mindful that such activities are not only driven from the outside, but often develop at home. By integrating relevant analytics on data already available, companies can build an effective defense against insider threats.

 

GTRI2

 Image courtesy of Ernst & Young.

 

GTRI2
 Image courtesy of Ernst & Young.
 
KEYWORDS: big data cyber espionage data analytics social media security

Share This Story

Looking for a reprint of this article?
From high-res PDFs to custom plaques, order your copy today!

Vincent Walden is a partner at Ernst & Young specializing in forensic technology, business intelligence and fraud detection analytics. With a focus on text analytics, forensic data mining, third party due diligence and electronic discovery services, Vincent has over fifteen years of experience handling the information management, forensic analysis and electronic discovery needs for large scale, complex litigations, investigations and proactive anti-fraud and compliance programs.

Recommended Content

JOIN TODAY
To unlock your recommendations.

Already have an account? Sign In

  • Iintegration and use of emerging tools

    Future Proof Your Security Career with AI Skills

    AI’s evolution demands security leaders master...
    Columns
    By: Jerry J. Brennan and Joanne R. Pollock
  • The 2025 Security Benchmark Report

    The 2025 Security Benchmark Report

    The 2025 Security Benchmark Report surveys enterprise...
    The Security Benchmark Report
    By: Rachelle Blair-Frasier
  • The Most Influential People in Security 2025

    Security’s Most Influential People in Security 2025

    Security Magazine’s 2025 Most Influential People in...
    Most Influential People in Security
    By: Security Staff
Manage My Account
  • Security Newsletter
  • eMagazine Subscriptions
  • Manage My Preferences
  • Online Registration
  • Mobile App
  • Subscription Customer Service

More Videos

Sponsored Content

Sponsored Content is a special paid section where industry companies provide high quality, objective, non-commercial content around topics of interest to the Security audience. All Sponsored Content is supplied by the advertising company and any opinions expressed in this article are those of the author and not necessarily reflect the views of Security or its parent company, BNP Media. Interested in participating in our Sponsored Content section? Contact your local rep!

close
  • critical event management
    Sponsored byEverbridge

    Why a Unified View Across IT, Continuity, and Security Makes or Breaks Crisis Response

  • Charlotte Star Room
    Sponsored byAMAROK

    In an Uncertain Economy, Security Is a Necessity - Not an Afterthought

  • Sureview screen
    Sponsored bySureView Systems

    The Evolution of Automation in the Command Center

Popular Stories

The Lourve

The Lourve Heist: What Was the State of the Museum’s Security?

The 2025 Security Benchmark Report

The 2025 Security Benchmark Report

Office supplies

Security Leaders Share Why 77% Organizations Lose Data Due to Insider Risks

American Airlines

Security Leaders Discuss Cyberattack on American Airlines Subsidiary

Going Down with the Ship

Going Down with the Ship

Top Cybersecurity Leaders

Events

September 18, 2025

Security Under Fire: Insights on Active Shooter Preparedness and Recovery

ON DEMAND: In today’s complex threat environment, active shooter incidents demand swift, coordinated and well-informed responses.

November 13, 2025

Inside the 2025 Security Benchmark Report

The 2025 Security Benchmark Report unveils the top trends CSOs and enterprise security executives are facing in today’s current climate and how each of these trends could potentially impact the enterprise’s global reputation with the public, governments, and business partners. 

View All Submit An Event

Products

Security Culture: A How-to Guide for Improving Security Culture and Dealing with People Risk in Your Organisation

Security Culture: A How-to Guide for Improving Security Culture and Dealing with People Risk in Your Organisation

See More Products

Related Articles

  • Big Data in Motion – Real Time Analytic Solutions for 21st Century Challenges

    See More
  • network-security-freepik1170.jpg

    Nation-state attacks are hard to spot. It’s time for a new approach to threat detection

    See More
  • smart-city-freepik1170x658b6.jpg

    Big data and smart cities: How to battle the pandemic while preserving privacy

    See More

Related Products

See More Products
  • threat and detection.jpg

    Surveillance and Threat Detection

  • security culture.webp

    Security Culture: A How-to Guide for Improving Security Culture and Dealing with People Risk in Your Organisation

  • school security.jpg

    School Security: How to Build and Strengthen a School Safety Program

See More Products

Events

View AllSubmit An Event
  • June 24, 2025

    Inside a Modern GSOC: How Anthropic Benchmarks Risk Detection Tools for Speed and Accuracy

    ON DEMAND: For today's security teams, making informed decisions in the first moments of a crisis is critical.
View AllSubmit An Event
×

Sign-up to receive top management & result-driven techniques in the industry.

Join over 20,000+ industry leaders who receive our premium content.

SIGN UP TODAY!
  • RESOURCES
    • Advertise
    • Contact Us
    • Store
    • Want More
  • SIGN UP TODAY
    • Create Account
    • eMagazine
    • Newsletter
    • Customer Service
    • Manage Preferences
  • SERVICES
    • Marketing Services
    • Reprints
    • Market Research
    • List Rental
    • Survey/Respondent Access
  • STAY CONNECTED
    • LinkedIn
    • Facebook
    • YouTube
    • X (Twitter)
  • PRIVACY
    • PRIVACY POLICY
    • TERMS & CONDITIONS
    • DO NOT SELL MY PERSONAL INFORMATION
    • PRIVACY REQUEST
    • ACCESSIBILITY

Copyright ©2025. All Rights Reserved BNP Media.

Design, CMS, Hosting & Web Development :: ePublishing