Single Machine Installation

Installing Everything In a Single Machine

This installation instruction has been verified on Ubuntu 20.04. Generally it should work with *nix like OS if you know how to equate the commands to install the appropriate software packages

Automated Script

git clone https://github.com/boodskap/boodskap.git
cd boodskap/install
./install.sh

Manual Installation

Perform the following actions as root or sudo access

sudo apt-get -y update
sudo apt-get -y update && apt-get install -y nginx sudo nodejs npm git software-properties-common libtinfo5 netcat tar curl net-tools nano wget unzip rsyslog psmisc 
sudo npm install pm2 -g

Install Java

We need to install both versions 8 & 13

sudo apt-get update -y
sudo apt-get install -y openjdk-8-jdk
sudo apt-get install -y openjdk-13-jdk

Also for process separation, we are going to create 6 different users for each software.

sudo adduser --disabled-password --gecos ""  boodskap
sudo adduser --disabled-password --gecos ""  boodskapui
sudo adduser --disabled-password --gecos ""  elastic
sudo adduser --disabled-password --gecos ""  cassandra
sudo adduser --disabled-password --gecos ""  emqtt
sudo adduser --disabled-password --gecos ""  kibana

🚧
Limits Tuning
Create a new file /etc/security/limits.d/21-limits.conf with the below content
*      soft   nofile      1048576
*      hard   nofile      1048576

🚧
System Parameters Tuning

Create a new file /etc/sysctl.d/101-z01-sysctl.conf with the below content

fs.file-max=2097152
fs.nr_open=2097152
net.core.somaxconn=32768
net.ipv4.tcp_max_syn_backlog=16384
net.core.netdev_max_backlog=16384
net.ipv4.ip_local_port_range=1024 65535
net.core.rmem_default=262144
net.core.wmem_default=262144
net.core.rmem_max=16777216
net.core.wmem_max=16777216
net.core.optmem_max=16777216

net.ipv4.tcp_mem=16777216 16777216 16777216
# net.ipv4.tcp_rmem=1024 4096 16777216
# net.ipv4.tcp_wmem=1024 4096 16777216
net.nf_conntrack_max=1000000
net.netfilter.nf_conntrack_max=1000000
net.netfilter.nf_conntrack_tcp_timeout_time_wait=30
net.ipv4.tcp_max_tw_buckets=1048576

# Enable fast recycling of TIME_WAIT sockets.  Enabling this
# option is not recommended for devices communicating with the
# general Internet or using NAT (Network Address Translation).
# Since some NAT gateways pass through IP timestamp values, one
# IP can appear to have non-increasing timestamps.
# net.ipv4.tcp_tw_recycle = 1
# net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_fin_timeout = 15

vm.dirty_writeback_centisecs=500
vm.swappiness=10
vm.zone_reclaim_mode=0
vm.extra_free_kbytes=1240000

vm.max_map_count = 262144

Reboot the system and proceed with the installation

Installing Cassandra

sudo su - cassandra

First time, edit the $HOME/.bash_profile file and enter the below contents

JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
PATH=$JAVA_HOME/bin:$PATH
export JAVA_HOME PATH

Now logout and login again

logout
sudo su - cassandra

cd $HOME
wget https://archive.apache.org/dist/cassandra/3.11.5/apache-cassandra-3.11.5-bin.tar.gz
tar -xzf apache-cassandra-3.11.5-bin.tar.gz
mv $HOME/apache-cassandra-3.11.5/* .
rm -rf $HOME/apache-cassandra-3.11.5*

Start the Cassandra service

$HOME/bin/cassandra

Installing Elastic Search

sudo su - elastic

First time, edit the $HOME/.bash_profile file and enter the below contents.

JAVA_HOME=/usr/lib/jvm/java-13-openjdk-amd64
PATH=$JAVA_HOME/bin:$PATH
export JAVA_HOME PATH

Now logout and login again and perform the below.

cd $HOME
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.5.1-linux-x86_64.tar.gz
tar -xzf elasticsearch-7.5.1-linux-x86_64.tar.gz
mv elasticsearch-7.5.1/* $HOME/
rm -rf $HOME/elasticsearch-7.5.1*

Start the Elastic Search service in background

$HOME/bin/elasticsearch &

🚧

If you run out of max shards open in elastic, you can dynamically increase it by

curl -X PUT elastic_host_or_ip:9200/_cluster/settings -H 'Content-type: application/json' --data-binary $'{"transient":{"cluster.max_shards_per_node":NUMBER_OF_SHARDS}}'

curl -X PUT elastic_host_or_ip:9200/_cluster/settings -H 'Content-type: application/json' --data-binary $'{"persistent":{"cluster.max_shards_per_node":NUMBER_OF_SHARDS}}'

Installing Kibana (Optional)

📘
Kibana
Kibana is optional service, but we recommend to install it, it comes in very handy to practice elasticsearch queries on the fly

sudo su - kibana

First time, edit the $HOME/.bash_profile file and enter the below contents.

JAVA_HOME=/usr/lib/jvm/java-13-openjdk-amd64
PATH=$JAVA_HOME/bin:$PATH
export JAVA_HOME PATH

Now logout and login again and perform the below.

cd $HOME
wget https://artifacts.elastic.co/downloads/kibana/kibana-7.5.1-linux-x86_64.tar.gz
tar -xzf kibana-7.5.1-linux-x86_64.tar.gz
mv kibana-7.5.1-linux-x86_64/* $HOME/
rm -rf $HOME/kibana-7.5.1-linux-x86_64

Start the Kibana Search service in background

$HOME/bin/kibana &

Installing EMQX

sudo su - emqtt

cd $HOME
wget --no-check-certificate  https://www.emqx.io/downloads/broker/v3.2.7/emqx-ubuntu18.04-v3.2.7.zip
unzip emqx-ubuntu18.04-v3.2.7.zip
mv emqx/* $HOME/
rm -rf $HOME/emqx
rm $HOME/emqx-ubuntu18.04-v3.2.7.zip
echo "{emqx_auth_http, true}." >> $HOME/data/loaded_plugins

👍
Configuring Authentication

Replace $HOME/etc/plugins/emqx_auth_http.conf file with the below contents

##--------------------------------------------------------------------
## HTTP Auth/ACL Plugin
##--------------------------------------------------------------------

## Authentication request.
##
## Variables:
##  - %u: username
##  - %c: clientid
##  - %a: ipaddress
##  - %l: accept port
##  - %P: password
##  - %C: common name of client TLS cert
##  - %d: subject of client TLS cert
##

auth.http.auth_req = http://localhost:18080/api/emqtt/get/auth
auth.http.auth_req.method = get
auth.http.auth_req.params = clientid=%c,username=%u,password=%P,ipaddr=%a

##--------------------------------------------------------------------
## Superuser request.
##
## Variables:
##  - %u: username
##  - %c: clientid
##  - %a: ipaddress
##  - %l: accept port
##  - %P: password
##  - %C: common name of client TLS cert
##  - %d: subject of client TLS cert
##
auth.http.super_req = http://localhost:18080/api/emqtt/get/superuser
auth.http.super_req.method = get
auth.http.super_req.params = clientid=%c,username=%u,ipaddr=%a

##--------------------------------------------------------------------
## ACL request.
##
## Variables:
##  - %A: 1 | 2, 1 = sub, 2 = pub
##  - %u: username
##  - %c: clientid
##  - %a: ipaddress
##  - %l: accept port
##  - %m: mountpoint
##  - %t: topic
##
auth.http.acl_req = http://localhost:18080/api/emqtt/acl
auth.http.acl_req.method = get
auth.http.acl_req.params = access=%A,username=%u,clientid=%c,ipaddr=%a,topic=%t

##------------------------------------------------------------------------------
## Http Reqeust options

## Time-out time for the http request, 0 is never timeout.
##
## Value: Duration
## -h: hour, e.g. '2h' for 2 hours
## -m: minute, e.g. '5m' for 5 minutes
## -s: second, e.g. '30s' for 30 seconds
##
## Default: 0
## auth.http.request.timeout = 0

## Connection time-out time, used during the initial request
## when the client is connecting to the server
##
## Value: Duration
##
## Default is same with the timeout option
## auth.http.request.connect_timout = 0

## Re-send http reuqest times
##
## Value: integer
##
## Default: 3
auth.http.request.retry_times = 3

## The interval for re-sending the http request
##
## Value: Duration
##
## Default: 1s
auth.http.request.retry_interval = 1s

## The 'Exponential Backoff' mechanism for re-sending request. The actually
## re-send time interval is `interval * backoff ^ times`
##
## Value: float
##
## Default: 2.0
auth.http.request.retry_backoff = 2.0

Start the Emqx service

$HOME/bin/emqx start

Boodskap Platform Installation

sudo su - boodskap

First time, edit the $HOME/.bash_profile file and enter the below contents.

JAVA_HOME=/usr/lib/jvm/java-13-openjdk-amd64
BOODSKAP_HOME=$HOME
PATH=$JAVA_HOME/bin:$BOODSKAP_HOME/bin:$PATH
export JAVA_HOME BOODSKAP_HOME PATH

Now logout and login again and perform the below.

cd $HOME
wget --no-check-certificate https://github.com/BoodskapPlatform/boodskap-platform/releases/download/v3.0.2/boodskap-3.0.2.tar.gz

tar -xzf boodskap-3.0.2.tar.gz

wget --no-check-certificate https://github.com/BoodskapPlatform/boodskap-platform/releases/download/v3.0.2/boodskap-patch-3.0.2-0019.tar.gz

tar -xzf boodskap-patch-3.0.2-0019.tar.gz

cd $HOME/libs/boodskap
rm -rf patches
ln -s $HOME/patches/0019 patches

Start the platform as background service.

$HOME/bin/ignite.sh -f $HOME/config/cluster.xml &

First Time Activation

$HOME/bin/control.sh --activate

For the very first time, the initialization may take a while depends upon your hardware

Once the initialization is over, you should see something like this in your console.


    )             (           )
 ( /(             )\ )     ( /(     )
 )\())  (    (   (()/( (   )\()) ( /(  `  )
((_)\   )\   )\   ((_)))\ ((_)\  )(_)) /(/(
| |(_) ((_) ((_)  _| |((_)| |(_)((_)_ ((_)_\
| '_ \/ _ \/ _ \/ _` |(_-<| / / / _` || '_ \)
|_.__/\___/\___/\__,_|/__/|_\_\ \__,_|| .__/
                                      |_| IoT Platform


>>> ver. 3.0.2 - build(0019)
>>> 2020 Copyright(C) Boodskap Inc
>>>
>>> Boodskap documentation: http://developer.boodskap.io

Boodskap UI Installation

Setup Developer Console UI

sudo su - boodskapui

mkdir $HOME/webapps
cd $HOME/webapps
git clone https://github.com/BoodskapPlatform/boodskap-ui.git
cd $HOME/webapps/boodskap-ui
npm install

Edit the $HOME/webapps/boodskap-ui/boodskapui.properties
Set the basepath=/platform

node build.js
pm2 start boodskap-platform-node.js

Setup Dashboard UI

cd $HOME/webapps
git clone https://github.com/BoodskapPlatform/platform-dashboard.git
cd $HOME/webapps/platform-dashboard
npm install
node build.js
pm2 start platform-dashboard-node.js

Configuring Nginx (Optional)

If you plan to use the platform locally for your development, you don't need to configure the Nginx, if you are planning to expose it to the internet, then you may need it.

There are two major parts of the platform, one is the core platform developer console and the other is the Dashboard UI application. Most of our customers keeps the platform within their intranet and expose only their dashboard solutions to the outer world.

If your IoT devices are going to use the REST services to push the messages to the platform, then you may need to expose the HTTP push API alone.

📘
Replace /etc/nginx/sites-enabled/default with the below contents.

proxy_cache_path /tmp/NGINX_cache/ keys_zone=backcache:10m;

map $http_upgrade $connection_upgrade {
    default upgrade;
    ''      close;
}

upstream api_cluster {
    server localhost:18080;
}

upstream micro_api_cluster {
    server localhost:19090;
}

upstream mqttws_cluster {
    server localhost:8083;
}

upstream platform_cluster {
    server localhost:4201;
}

upstream dashboard_cluster {
    server localhost:10000;
}

server {
    listen 80;
    client_max_body_size 20M;

    location /api {

        if ($request_method = 'OPTIONS') {
		add_header 'Access-Control-Allow-Origin' '*';
		add_header 'Access-Control-Allow-Credentials' 'true';
		add_header 'Access-Control-Allow-Headers' 'Authorization,Accept,Origin,DNT,X-CustomH
eader,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Content-Ra
nge,Range';
		add_header 'Access-Control-Allow-Methods' 'GET,POST,OPTIONS,PUT,DELETE,PATCH';
		add_header 'Access-Control-Max-Age' 1728000;
		add_header 'Content-Type' 'text/plain charset=UTF-8';
		add_header 'Content-Length' 0;
		return 204;
	}

	if ($request_method !~ ^(HEAD|GET|POST|PUT|DELETE)$ )
	{
		return 405;
	}
        proxy_pass http://api_cluster;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-NginX-Proxy true;
        proxy_ssl_session_reuse off;
        proxy_cache backcache;
        proxy_buffer_size          256M;
        proxy_buffers              4 512M;
        proxy_busy_buffers_size    512M;
    }

    location /mservice {

        proxy_pass http://micro_api_cluster;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-NginX-Proxy true;
        proxy_ssl_session_reuse off;
        proxy_cache backcache;
    }

    location /mqtt {

        proxy_pass http://mqttws_cluster;
        proxy_http_version 1.1;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection "upgrade";
        proxy_redirect  off;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-NginX-Proxy true;
        proxy_ssl_session_reuse off;
        proxy_cache backcache;
    }

    location /platform {

        proxy_pass http://platform_cluster;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-NginX-Proxy true;
        proxy_ssl_session_reuse off;
        proxy_cache backcache;
        proxy_buffer_size          128k;
        proxy_buffers              4 256k;
        proxy_busy_buffers_size    256k;
    }

    location / {

        proxy_pass http://dashboard_cluster;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-NginX-Proxy true;
        proxy_ssl_session_reuse off;
        proxy_cache backcache;
        proxy_buffer_size          128k;
        proxy_buffers              4 256k;
        proxy_busy_buffers_size    256k;
    }

}

Single Machine Installation

Installing Everything In a Single Machine

Automated Script

Manual Installation

Install Java

🚧
Limits Tuning

🚧
System Parameters Tuning

Reboot the system and proceed with the installation

Installing Cassandra

Installing Elastic Search

🚧

Installing Kibana (Optional)

📘
Kibana

Installing EMQX

👍
Configuring Authentication

Boodskap Platform Installation

Boodskap UI Installation

Setup Developer Console UI

Setup Dashboard UI

Configuring Nginx (Optional)

📘
Replace /etc/nginx/sites-enabled/default with the below contents.

Installing Everything In a Single Machine

Automated Script

Manual Installation

Install Java

🚧Limits Tuning

🚧System Parameters Tuning

Reboot the system and proceed with the installation

Installing Cassandra

Installing Elastic Search

🚧

Installing Kibana (Optional)

📘Kibana

Installing EMQX

👍Configuring Authentication

Boodskap Platform Installation

Boodskap UI Installation

Setup Developer Console UI

Setup Dashboard UI

Configuring Nginx (Optional)

📘Replace /etc/nginx/sites-enabled/default with the below contents.

🚧
Limits Tuning

🚧
System Parameters Tuning

📘
Kibana

👍
Configuring Authentication

📘
Replace /etc/nginx/sites-enabled/default with the below contents.