Skip to main content
Opsgenie

Scheduled report functionality is disabled

Degraded Lasted 6d 2h · started · Opsgenie's page

Level
confirmed
Worst impact
Degraded
Components
Reporting & Analytics, Reporting & Analytics
Down Index
24of 100

What to do

  • Check whether you use Opsgenie Reporting & Analytics, Reporting & Analytics. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 6d 2h it lasted.

    Anything that failed between 2023-11-18 11:41 UTC and 2023-11-24 14:23 UTC may need a replay.
  • Subscribe to Opsgenie's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=opsgenie works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Opsgenie 6

  1. investigating

    Scheduled report functionality is disabled as we suspect a possible spam activity. Only the reports with a custom schedules are disabled, periodic emails are not impacted. The team is investigating the issue and will provide more update.

    provider

  2. identified

    The cause of the issue is identified, and the team is working on the fix.

    provider

  3. identified

    The root cause is identified and the spam activity is mitigated. The team is working on adding more controls to prevent further spam activities. The scheduled report feature will be kept disabled for a while until the further controls implemented. However, the reporting service is fully available and the reports can be downloaded manually via the reporting page.

    provider

  4. identified

    We have implemented additional controls and are introducing domain restrictions as well as limitations to the number of recipients for mitigation purposes. Scheduled reports will be enabled for all customers on November 24th, PST. Users will begin receiving emails for the reports they have scheduled for themselves and they will also have the ability to create new tasks. We will share more updates when the changes are fully implemented.

    provider

  5. monitoring

    The changes have been shipped to production, and scheduled reports are enabled now.

    provider

  6. resolved

    We're excited to inform you that we've shipped upgrades to our production environment, enabling scheduled reports once again. What's Changed: To continuously improve and ensure the security of our services, we've implemented additional controls including domain restrictions and a limitation on the number of recipients per email. This is specifically for mitigation purposes. From now on, users will start receiving emails for the reports they've scheduled for themselves, and they will also have the ability to create new tasks. Impact: Please note that any existing scheduled jobs with external recipients will no longer be editable. However, users can delete these and create new jobs using their email IDs. Thank you for your patience during these changes. We want to assure you that future updates and communications will be shared promptly to keep you informed. We appreciate your understanding and continued support.

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-4df25d3750

Is Opsgenie still down?

No, this incident was resolved 2023-11-24 14:23 UTC. For Opsgenie's live state, see https://down.guide/opsgenie.

How long did it last?

6d 2h, from 2023-11-18 11:41 UTC to 2023-11-24 14:23 UTC, by the times Opsgenie posted.

What was affected?

Opsgenie named Reporting & Analytics, Reporting & Analytics.

What caused it?

Opsgenie hasn't published a root cause. If it does, it shows here.

Where does this come from?

Opsgenie's official status page, https://opsgenie.status.atlassian.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.