Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
Neutrinet
infra-ansible
Commits
f7aa313a
Commit
f7aa313a
authored
Aug 12, 2021
by
HgO
Browse files
config mail template and add base rules
parent
9e8288f6
Changes
6
Hide whitespace changes
Inline
Side-by-side
roles/alertmanager/defaults/main.yml
View file @
f7aa313a
alertmanager_smtp_host
:
localhost
alertmanager_smtp_port
:
25
alertmanager_smtp_from
:
alertmanager@example.com
alertmanager_smtp_to
:
dringdring@
example.com
alertmanager_smtp_username
:
alertmanager
alertmanager_smtp_password
:
neutrinet
alertmanager_smtp_to
:
dringdring@
localhost
alertmanager_smtp_username
:
"
"
alertmanager_smtp_password
:
"
"
roles/alertmanager/files/alertmanager/base.rules
0 → 100644
View file @
f7aa313a
groups:
- name: Health
rules:
- alert: Instance Down
for: 5m
expr: up == 0
labels:
severity: critical
annotations:
description: 'Instance is down'
summary: 'Instance is down'
- name: Disk Usage
rules:
- alert: Low Disk Space
for: 1h
expr: disk_used_percent > 90
labels:
severity: critical
annotations:
description: 'Device {{ $labels.device }} mounted on "{{ $labels.path }}" has low disk space (value = {{ humanize $value }}%)'
summary: 'Disk usage is at {{ humanize $value }}%'
- alert: Disk Full Next Week
for: 1h
expr: predict_linear(disk_used_percent[2d], 7*24*3600) > 100
labels:
severity: critical
annotations:
description: 'Based on disk usage from last 2 days, device {{ $labels.device }} mounted on "{{ $labels.path }}" will be full within the week'
summary: 'Disk full within the week'
- name: Memory Usage
rules:
- alert: High Memory Usage
for: 15m
expr: mem_used_percent > 80
labels:
severity: critical
annotations:
description: 'Memory usage is higher than 80%.'
summary: 'Memory usage is at {{ humanize $value }}%'
- alert: Memory Full Next Week
for: 1h
expr: predict_linear(mem_used_percent[2d], 7*24*3600) > 100
labels:
severity: critical
annotations:
description: 'Based on memory usage from last 2 days, the host will be out of memory within the week'
summary: 'Memory full within the week'
- name: CPU Usage
rules:
- alert: High CPU Usage
for: 15m
expr: 100 * system_load5 / system_n_cpus > 90
labels:
severity: critical
annotations:
description: 'CPU usage is higher than 90%'
summary: 'CPU usage is at {{ humanize $value }}%'
roles/alertmanager/files/alertmanager/email.tmpl
0 → 100644
View file @
f7aa313a
<!--
Style and HTML derived from https://github.com/mailgun/transactional-email-templates
The MIT License (MIT)
Copyright (c) 2014 Mailgun
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
-->
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html
xmlns=
"http://www.w3.org/1999/xhtml"
>
<head>
<meta
name=
"viewport"
content=
"width=device-width"
/>
<meta
http-equiv=
"Content-Type"
content=
"text/html; charset=UTF-8"
/>
<title>
{{ template "__subject" . }}
</title>
<style>
/* -------------------------------------
GLOBAL
A very basic CSS reset
------------------------------------- */
*
{
margin
:
0
;
font-family
:
"Helvetica Neue"
,
Helvetica
,
Arial
,
sans-serif
;
box-sizing
:
border-box
;
font-size
:
14px
;
}
img
{
max-width
:
100%
;
}
body
{
-webkit-font-smoothing
:
antialiased
;
-webkit-text-size-adjust
:
none
;
width
:
100%
!important
;
height
:
100%
;
line-height
:
1.6em
;
/* 1.6em * 14px = 22.4px, use px to get airier line-height also in Thunderbird, and Yahoo!, Outlook.com, AOL webmail clients */
/*line-height: 22px;*/
}
/* Let's make sure all tables have defaults */
table
td
{
vertical-align
:
top
;
}
/* -------------------------------------
BODY & CONTAINER
------------------------------------- */
body
{
background-color
:
#f6f6f6
;
}
.body-wrap
{
background-color
:
#f6f6f6
;
width
:
100%
;
}
.container
{
display
:
block
!important
;
max-width
:
600px
!important
;
margin
:
0
auto
!important
;
/* makes it centered */
clear
:
both
!important
;
}
.content
{
max-width
:
600px
;
margin
:
0
auto
;
display
:
block
;
padding
:
20px
;
}
/* -------------------------------------
HEADER, FOOTER, MAIN
------------------------------------- */
.main
{
background-color
:
#fff
;
border
:
1px
solid
#e9e9e9
;
border-radius
:
3px
;
}
.content-wrap
{
padding
:
30px
;
}
.content-block
{
padding
:
0
0
20px
;
}
.header
{
width
:
100%
;
margin-bottom
:
20px
;
}
.footer
{
width
:
100%
;
clear
:
both
;
color
:
#999
;
padding
:
20px
;
}
.footer
p
,
.footer
a
,
.footer
td
{
color
:
#999
;
font-size
:
12px
;
}
/* -------------------------------------
TYPOGRAPHY
------------------------------------- */
h1
,
h2
,
h3
{
font-family
:
"Helvetica Neue"
,
Helvetica
,
Arial
,
"Lucida Grande"
,
sans-serif
;
color
:
#000
;
margin
:
40px
0
0
;
line-height
:
1.2em
;
font-weight
:
400
;
}
h1
{
font-size
:
32px
;
font-weight
:
500
;
/* 1.2em * 32px = 38.4px, use px to get airier line-height also in Thunderbird, and Yahoo!, Outlook.com, AOL webmail clients */
/*line-height: 38px;*/
}
h2
{
font-size
:
24px
;
/* 1.2em * 24px = 28.8px, use px to get airier line-height also in Thunderbird, and Yahoo!, Outlook.com, AOL webmail clients */
/*line-height: 29px;*/
}
h3
{
font-size
:
18px
;
/* 1.2em * 18px = 21.6px, use px to get airier line-height also in Thunderbird, and Yahoo!, Outlook.com, AOL webmail clients */
/*line-height: 22px;*/
}
h4
{
font-size
:
14px
;
font-weight
:
600
;
}
p
,
ul
,
ol
{
margin-bottom
:
10px
;
font-weight
:
normal
;
}
p
li
,
ul
li
,
ol
li
{
margin-left
:
5px
;
list-style-position
:
inside
;
}
/* -------------------------------------
LINKS & BUTTONS
------------------------------------- */
a
{
color
:
#348eda
;
text-decoration
:
underline
;
}
.btn-primary
{
text-decoration
:
none
;
color
:
#FFF
;
background-color
:
#348eda
;
border
:
solid
#348eda
;
border-width
:
10px
20px
;
line-height
:
2em
;
/* 2em * 14px = 28px, use px to get airier line-height also in Thunderbird, and Yahoo!, Outlook.com, AOL webmail clients */
/*line-height: 28px;*/
font-weight
:
bold
;
text-align
:
center
;
cursor
:
pointer
;
display
:
inline-block
;
border-radius
:
5px
;
text-transform
:
capitalize
;
}
/* -------------------------------------
OTHER STYLES THAT MIGHT BE USEFUL
------------------------------------- */
.last
{
margin-bottom
:
0
;
}
.first
{
margin-top
:
0
;
}
.aligncenter
{
text-align
:
center
;
}
.alignright
{
text-align
:
right
;
}
.alignleft
{
text-align
:
left
;
}
.clear
{
clear
:
both
;
}
/* -------------------------------------
ALERTS
Change the class depending on warning email, good email or bad email
------------------------------------- */
.alert
{
font-size
:
16px
;
color
:
#fff
;
font-weight
:
500
;
padding
:
20px
;
text-align
:
center
;
border-radius
:
3px
3px
0
0
;
}
.alert
a
{
color
:
#fff
;
text-decoration
:
none
;
font-weight
:
500
;
font-size
:
16px
;
}
.alert.alert-warning
{
background-color
:
#E6522C
;
}
.alert.alert-bad
{
background-color
:
#D0021B
;
}
.alert.alert-good
{
background-color
:
#68B90F
;
}
/* -------------------------------------
INVOICE
Styles for the billing table
------------------------------------- */
.invoice
{
margin
:
40px
auto
;
text-align
:
left
;
width
:
80%
;
}
.invoice
td
{
padding
:
5px
0
;
}
.invoice
.invoice-items
{
width
:
100%
;
}
.invoice
.invoice-items
td
{
border-top
:
#eee
1px
solid
;
}
.invoice
.invoice-items
.total
td
{
border-top
:
2px
solid
#333
;
border-bottom
:
2px
solid
#333
;
font-weight
:
700
;
}
/* -------------------------------------
RESPONSIVE AND MOBILE FRIENDLY STYLES
------------------------------------- */
@media
only
screen
and
(
max-width
:
640px
)
{
body
{
padding
:
0
!important
;
}
h1
,
h2
,
h3
,
h4
{
font-weight
:
800
!important
;
margin
:
20px
0
5px
!important
;
}
h1
{
font-size
:
22px
!important
;
}
h2
{
font-size
:
18px
!important
;
}
h3
{
font-size
:
16px
!important
;
}
.container
{
padding
:
0
!important
;
width
:
100%
!important
;
}
.content
{
padding
:
0
!important
;
}
.content-wrap
{
padding
:
10px
!important
;
}
.invoice
{
width
:
100%
!important
;
}
}
</style>
</head>
<body
itemscope
itemtype=
"http://schema.org/EmailMessage"
>
<table
class=
"body-wrap"
>
<tr>
<td></td>
<td
class=
"container"
width=
"600"
>
<div
class=
"content"
>
<table
class=
"main"
width=
"100%"
cellpadding=
"0"
cellspacing=
"0"
>
<tr>
{{ if gt (len .Alerts.Firing) 0 }}
<td
class=
"alert alert-warning"
>
{{ else }}
<td
class=
"alert alert-good"
>
{{ end }}
{{ .Alerts | len }} alert{{ if gt (len .Alerts) 1 }}s{{ end }} for {{ range .GroupLabels.SortedPairs }}
{{ .Name }}={{ .Value }}
{{ end }}
</td>
</tr>
<tr>
<td
class=
"content-wrap"
>
<table
width=
"100%"
cellpadding=
"0"
cellspacing=
"0"
>
<tr>
<td
class=
"content-block"
>
<a
href=
'{{ template "__alertmanagerURL" . }}'
class=
"btn-primary"
>
View in {{ template "__alertmanager" . }}
</a>
</td>
</tr>
{{ if gt (len .Alerts.Firing) 0 }}
<tr>
<td
class=
"content-block"
>
<strong>
[{{ .Alerts.Firing | len }}] Firing
</strong>
</td>
</tr>
{{ end }}
{{ range .Alerts.Firing }}
<tr>
<td
class=
"content-block"
>
<strong>
Labels
</strong><br
/>
{{ range .Labels.SortedPairs }}{{ .Name }} = {{ .Value }}
<br
/>
{{ end }}
{{ if gt (len .Annotations) 0 }}
<strong>
Annotations
</strong><br
/>
{{ end }}
{{ range .Annotations.SortedPairs }}{{ .Name }} = {{ .Value }}
<br
/>
{{ end }}
<a
href=
"{{ .GeneratorURL }}"
>
Source
</a><br
/>
</td>
</tr>
{{ end }}
{{ if gt (len .Alerts.Resolved) 0 }}
{{ if gt (len .Alerts.Firing) 0 }}
<tr>
<td
class=
"content-block"
>
<br
/>
<hr
/>
<br
/>
</td>
</tr>
{{ end }}
<tr>
<td
class=
"content-block"
>
<strong>
[{{ .Alerts.Resolved | len }}] Resolved
</strong>
</td>
</tr>
{{ end }}
{{ range .Alerts.Resolved }}
<tr>
<td
class=
"content-block"
>
<strong>
Labels
</strong><br
/>
{{ range .Labels.SortedPairs }}{{ .Name }} = {{ .Value }}
<br
/>
{{ end }}
{{ if gt (len .Annotations) 0 }}
<strong>
Annotations
</strong><br
/>
{{ end }}
{{ range .Annotations.SortedPairs }}{{ .Name }} = {{ .Value }}
<br
/>
{{ end }}
<a
href=
"{{ .GeneratorURL }}"
>
Source
</a><br
/>
</td>
</tr>
{{ end }}
</table>
</td>
</tr>
</table>
<div
class=
"footer"
>
<table
width=
"100%"
>
<tr>
<td
class=
"aligncenter content-block"
><a
href=
'{{ .ExternalURL }}'
>
Sent by {{ template "__alertmanager" . }}
</a></td>
</tr>
</table>
</div></div>
</td>
<td></td>
</tr>
</table>
</body>
</html>
roles/alertmanager/molecule/default/prepare.yml
View file @
f7aa313a
...
...
@@ -10,4 +10,5 @@
cache_valid_time
:
3600
roles
:
-
telegraf
-
prometheus
roles/alertmanager/tasks/main.yml
View file @
f7aa313a
...
...
@@ -12,6 +12,15 @@
mode
:
"
u=rw,g=r,o=r"
notify
:
restart alertmanager
-
name
:
Configuration du template des notifications mail
copy
:
src
:
alertmanager/email.tmpl
dest
:
/etc/prometheus/alertmanager_templates/email.tmpl
owner
:
root
group
:
root
mode
:
"
u=rw,go=r"
notify
:
reload alertmanager
-
name
:
Configuration d'Alertmanager
template
:
src
:
alertmanager/alertmanager.yml.j2
...
...
@@ -36,11 +45,19 @@
mode
:
"
u=rw,go=r"
notify
:
reload prometheus
-
name
:
Création du dossier des
rul
es
-
name
:
Création du dossier des
alert
es
file
:
path
:
/etc/prometheus/rules.d
owner
:
prometheus
group
:
prometheus
mode
:
"
u=rwx,g=rx,o="
state
:
directory
-
name
:
Copie des alertes de base
copy
:
src
:
alertmanager/base.rules
dest
:
/etc/prometheus/rules.d/base.rules
owner
:
root
group
:
root
mode
:
"
u=rw,go=r"
notify
:
reload prometheus
roles/alertmanager/templates/alertmanager/alertmanager.yml.j2
View file @
f7aa313a
...
...
@@ -6,8 +6,10 @@ global:
# The smarthost and SMTP sender used for mail notifications.
smtp_smarthost: {{ alertmanager_smtp_host }}:{{ alertmanager_smtp_port }}
smtp_from: {{ alertmanager_smtp_from }}
{% if alertmanager_smtp_username and alertmanager_smtp_password %}
smtp_auth_username: {{ alertmanager_smtp_username | to_json }}
smtp_auth_password: {{ alertmanager_smtp_password | string | to_json }}
{% endif %}
# The directory from which notification templates are read.
templates:
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment