Project

General

Profile

Task #2210

monitoring notifications

Added by Florian Effenberger 9 months ago. Updated 27 days ago.

Status:
New
Priority:
High
Category:
-
Target version:
Team - Q4/2017
Start date:
Due date:
% Done:

0%

Estimated time:
Tags:
URL:

Description

The monitoring system doesn't send notifications properly, and not everyone uses Telegram.
We should switch to e-mail, by which we then can also use SMS via a gateway and PushOver for those who use it, or NotifyMyAndroid.

History

#1 Updated by Florian Effenberger 5 months ago

  • Priority changed from Normal to High
  • Target version changed from Q2/2017 to Q3/2017

For my private boxes I've switched to PushOver (which needs some small investment as we need to buy licenses)
TDF also has a SMS gateway we can use
Both can be fed via e-mail if required, with PushOver giving some more flexibility

In first place we should ensure proper notification via e-mail, as this can then be easily expanded to one of the other services
Assigning it a High priority for Q3

#2 Updated by Florian Effenberger 3 months ago

  • Target version changed from Q3/2017 to Q4/2017

Shifting to Q4 for further work on it, but I'd be interested if there was any progress in Q3

#3 Updated by Guilhem Moulin 3 months ago

Unfortunately not :-/ I'm still using grafana for monitoring, which of course is highly suboptimal as it lacks notifications.

#4 Updated by Florian Effenberger 3 months ago

Unfortunately not :-/ I'm still using grafana for monitoring, which of
course is highly suboptimal as it lacks notifications.

Then let's address that early in Q4

#5 Updated by Florian Effenberger about 1 month ago

A topic for the next admin call would be to agree on a method to deliver notifications
E-mail for sure, but a direct push message to the mobile as well would be very much desirable

I see three choices:

  • use GMail's push feature -> drawback: everyone needs a @gmail.com address and I'm not sure if certain mails can create a direct alert
  • use SMS notification -> drawback: small fee, limited amount of text; advantages: works everywhere even w/o data
  • use PushOver -> drawback: license costs; advantages: works on Android, iOS and browser push notification
  • use a Telegram bot -> no insight into that, but could be the least expensive solution; works on desktops too
  • add your proposals here

I tried NotifiyMyAndroid which seems to work as well (but also has some license fee), however it was impossible for me to reach the vendor by any means, so I'd not pursue that further.

#6 Updated by Guilhem Moulin 27 days ago

From the Nov. 21 infra call minutes:

  • SMS is the way to go, but we need to the ability to specify schedules
    so not everyone is waken up in the middle of the night
  • cloph: want to revive the telegram notifications that we had in the
    past (TDF Monitoring bot)
  • Norbert: need the ability to temporarily disable the rules when doing
    manual maintenance
  • Norbert: it's crucial to avoid false positives (cf. infra ML…)

Also available in: Atom PDF