spyware, cyber, cyber crime, security, technology, internet, computer, privacy, protection, web, hacker, online, theft, safe, virus, hacking, phishing, data, blue computer, blue virus, blue technology, blue laptop, blue data, blue online, blue internet, blue security, blue web, spyware, spyware, cyber, cyber, cyber crime, hacker, hacker, phishing, phishing, phishing, phishing, phishing. Phishing defense software: three jobs, one buying order
Photo by Macedo_Media on Pixabay

Rules

Part of Where phishing defense actually starts: MFA on email, not training

Phishing defense software: three jobs, one buying order

Phishing defense software does three jobs: filtering, post-delivery response and awareness. Here is the buying order, the tests, and what to do first.

Mistake: Buying a label instead of the missing protection

The costliest mistake in phishing defense software is buying for the wrong phishing problem: a filter changes incoming mail volume, a post-delivery response loop handles messages already delivered, and awareness software aims to change staff behavior. Choose the missing job first. A broad protection label can leave the actual point of failure untouched.

These categories have different owners, costs, and failure modes. Microsoft Defender for Office 365 and Proofpoint may appear in filter quotations; Cofense is associated with reporting and removal, while KnowBe4 and Hoxhunt are names for awareness training. Treat the names as orientation, not a shortlist.

Vendor lineups and prices change each year, but evaluation questions remain stable. The National Cyber Security Centre offers free phishing and email security guidance with a layered approach. Read its phishing guidance before a demonstration, so your team can explain its needs in its own terms.

ProductWhat it changesWho feels a failureA useful test
FilterHow much mail arrivesAnyone waiting for held mailSend ordinary traffic through it, then time a release
Response loopWhat happens after deliveryEvery mailbox that still holds the messageReport a benign message and time its removal end to end
Awareness platformWhat staff doStaff trust if exercises go wrongReview report rate, not click rate

Payment fraud by email sits outside these three categories: filtering, post-delivery response, and awareness do not solve it. Evaluate that separately with business email compromise software, rather than letting a combined sales pitch blur the boundary. Keep its test and budget distinct from the phishing jobs being compared.

Mistake: Paying before switching on existing controls

The mistake is paying for another layer before enabling controls already available. Those controls are usually included and can change outcomes more than another purchase. Turn on mail protections and account safeguards first, then identify the remaining gap. For account safeguards, start with MFA on email.

Buy in this order

  1. Turn on what you already own first
  2. Then buy the response loop
  3. Then the filter, sized to volume
  4. Then the awareness platform, if budget
  1. Turn on domain mail authentication, external sender marking, alerts for new mailbox rules and forwarding, and multi-factor authentication for every account that can reach mail.
  2. Buy the response loop next. It is cheap, often part of the platform you already have, and turns staff from a liability into your fastest sensor.
  3. Add a filter sized to the volume problem you actually have, not the problem described in a proposal.
  4. Buy an awareness platform only if there is budget and someone to run it.

Payment fraud is not solved by those steps, even when products are sold together. Keep the evaluation separate with business email compromise comparison. This buying order distinguishes phishing protection from payment-fraud prevention and makes each purchase answer an identified gap, rather than allowing a bundle to imply otherwise.

Mistake: Letting a bundle stand in for component checks

A bundle can suggest complete protection while concealing a weak component. Several products claim all three jobs, and a combined price may let a strong filter disguise a weak response loop. Assess every component on its own, even if the total appears attractive.

Require clear terms for the service tier you would actually buy. Retention should state how long reports, quarantine records, and message traces remain available. Export should provide data in a format you can open, and you should test it during the trial rather than waiting until the relationship ends.

  • Administrative visibility:Confirm you can see who changed a policy and when.
  • Coverage:Check the mobile clients, shared mailboxes, aliases, and any address receiving outside mail that you use.
  • Named owner:Assign someone on your side who is responsible for the service.

Score the three tests separately so the combined price cannot obscure the results. Assign responsibility to whoever will read the reports; if nobody will, buy the response loop and skip the rest. An unread alert stream is a subscription with no output. Compare the choice with security foundations comparison as part of the wider approach.

Mistake: Ending the trial when installation works

Ending a trial when installation works mistakes setup for evidence. Installation does not reveal behavior under ordinary traffic, a busy period, or the first false positives. Keep the test running long enough to see those conditions and establish the service limits that matter.

Include a normal week and a busy one, and continue until the first wave of false positives arrives. It usually comes in the second week rather than the first. Anything shorter tests installation, not the product. See incident response reviews for questions to ask before signing.

If your mail platform already includes filtering, find out how it is configured before buying another layer. You may discover the existing filter was left on defaults. For a small business, configuring what you own is a project rather than a purchase, and it often closes the gap the proposed purchase was meant to fill.

During the trial, establish who releases held messages, what support is included, how quickly reports lead to removal, and whether required records and exports are available. A named internal owner must be able to act on reports; without one, extra products can leave the same operational gap in place.

Mistake: Assuming a report button finishes the response

A report button without a response loop leaves staff able to flag a threat while nobody locates it across mailboxes or removes it promptly. Require a reporting route, mailbox-wide search and removal, and a named person with authority to act.

Test the response loop

  1. Deliver benign message to test mailboxes
  2. Report it through the one-click button
  3. Time removal end to end
  4. Include the human step in timing

Require a one-click report button in the mail client on desktop and mobile, with reports sent somewhere a named person will see them. The product must search all mailboxes for a reported message and remove it from each one within a stated, measured time. Judge its incident capabilities by when they matter.

The reporter should receive a reply, even an automated one, so reporting does not feel like shouting into a drain. The system should also retain a record of what it found and recognize the same message when it is reported again. Together, these steps connect reporting to the response that follows.

Ask what happens when a message reaches forty mailboxes and one person reports it: how long until it is gone from the other thirty-nine, and who can press the button at seven in the morning? Test that exact situation with a benign message delivered to a handful of test mailboxes.

Report the test message using the button and time the full process, including the human step. That interval says more than detection claims, and it is the number vendors do not publish. The most important feature may be the least demonstrated: how fast a delivered message can be pulled from mailboxes. Make its measured behavior a purchase criterion.

Mistake: Approving a filter after it catches easy attacks

A filter that catches obvious attacks has not shown how it handles ambiguous mail. Every filter catches the obvious; uncertain messages expose the uneven cost of a wrong decision, a cost vendors do not lead with. Test ordinary traffic and measure what holds and releases mean for your work.

Filter requirements to demand

  • Users review quarantine without a ticket
  • Release path takes minutes, not a day
  • Per-user and per-domain allow decisions
  • Uncertain mail marked, not silently blocked
  • Vendor states what happens to unsure mail

Ask what share of your own inbound mail will be held during the first fortnight, and who will release it. A customer purchase order held over a weekend may cost more than the filter saves. Sales can absorb that loss even though the buying team selected the filter.

False positives also have a human cost, often falling on people least able to resolve them, and the burden may differ from the expense visible to the buyer. Test ordinary commercial traffic, including messages that matter to your work, rather than relying on a vendor demonstration.

Use invoices with attachment types you receive, mail from a new customer domain, and messages from a supplier using a third-party platform. Then time a release through the support channel included in the service tier you would buy. This checks both the filter decision and the route back to legitimate mail.

Mistake: Using click rate as the training score

Buying awareness software to win a click-rate contest gives an unreliable measure and can create ethical problems. Click rate depends on the message selected, so it cannot show a dependable trend. Measure reporting instead and protect staff trust when setting expectations.

Click rate vs reporting rate

Click rate

Depends on
Message chosen
Use as trend
Useless
Predicts incident
No
Feeds response plan
No

Reporting rate

Depends on
Your organization
Use as trend
Predictive
Predicts incident
Yes
Feeds response plan
Yes

Choose short, frequent exercises rather than an annual course. Break results down by team, not individual, and let your own staff adapt material to your context. Configure the platform to measure reporting, then record report rate and time to first report as outcomes.

Changing the selected message can move click rate up or down, so it cannot show a dependable trend. Reporting rate belongs to your organization and indicates how an incident may go; time to first report also affects when containment can begin under the incident response plan.

Before paying for content, compare it with published material. The United States Cybersecurity and Infrastructure Security Agency runs Secure Our World, a public awareness program with tip sheets and other resources. Put the paid library beside those materials to see what extra value it provides.

  • Nobody is disciplined for clicking or reporting, and the platform is not configured to name individuals to their managers.
  • Exercises never use themes that trade on people's livelihoods or personal circumstances. Damage to trust lasts beyond the lesson, and the reporting culture built over a year can disappear with it.

More in Rules

Latest from Reporting Desk