This 5his page describes the steps for installing Smartfacts for testing Smartfacts in a Proof of Concept. To simplify the installation process, Smartfacts is not connected to your OIDC provider. Instead, a Keycloak is contained in the deployment, which is used as the OIDC provider.
Table of Contents | ||||
---|---|---|---|---|
|
Preparations
If not done so far please prepare your infrastructure as described in https://smartfacts.atlassian.net/wiki/spaces/SPD/pages/54624257/Installing+Smartfacts+for+Proof+of+Concepts#Prepare-your-infrastructure.
Setup the Kubernetes Environment
You need a Kubernetes cluster to deploy Smartfacts in. If you already have a Kubernetes infrastructure on AWS, GCP or Azure, you can use this.
...
If you don’t have a Kubernetes infrastructure you can set up a single node cluster at a vm. The following section will describe how to set zu such a cluster.
Install k3s
If your server only reaches the Internet via a proxy, you must set up your environment so that this proxy is used with k3s and helm. If this is the case, follow the instructions in this section:
...
Code Block |
---|
curl -sfL https://get.k3s.io | INSTALL_K3S_VERSION=v1.27.9+k3s1 sh - |
Wait 30 seconds.
You can test it with the command sudo kubectl get node
. It will provide an output similar to this one:
...
For more information see: https://rancher.com/docs/k3s/latest/en/quick-start
Install helm
Code Block |
---|
curl -fsSL -o get_helm.sh https://raw.githubusercontent.com/helm/helm/main/scripts/get-helm-3 && chmod 700 get_helm.sh && ./get_helm.sh |
For more information see: https://helm.sh/docs/intro/install
Set Link to Cluster Configuration
Code Block |
---|
sudo mkdir -p /root/.kube sudo ln -s /etc/rancher/k3s/k3s.yaml /root/.kube/config |
Prepare Deployment
Add MID Repository
You will need a username and password to download the helm chart and containers from MID's repository. You will receive username and password from your MID contact or from cops@mid.de.
...
Code Block |
---|
sudo helm repo update |
Provide Certificates and Key as Base64 String
Make sure that the complete certificate chain is contained in a file in correct order in x509 PEM format. The content of certificates in PEM formate looks like this:
...
Code Block |
---|
cat <your certificate key.key> | base64 -w0 > key.base64 |
Customize Values File
Change to your user's home directory on the server and create a new text file
values.yaml
with the following content:Code Block global: domain: "<your-domain>" instance: "smartfacts-poc" registry: "repo.mid.de" repologin: <login provided by MID> cert: crtFullChain: "<FULL-CHAIN-CERT-BASE64>" key: "<CERT-KEY-BASE64>" ingress: enabled: true # Smartfacts supports Traefik and nginx as Ingress Controller. # The default is Traefik. # If you use nginx as ingress controller please comment in this line: #ingressClassType: "nginx" spa: cspConf: externalUrls: "" # space separated list of your tool urls (IBM Jazz, Jama, Codebeamer) plugin: importPlugins: true # "true" for first installation, "false" for minor updates will speed up the update process a lot genoslc: enabled: true # Set to false if you want to use Smartfacts only (no OSLC connection to itgerother tools). In this case you canncan skip the rest of this "genoslc" section. env: trsEnabled: false # Set to true if you use Smartfacts as data source for a link index configuration: # Give a list of up to 5 usernames of users which will have the administration right to change settings in Smartfacts. # At leas one administrator user must be stated here. administrators: - acm # replace this value with the username of the person who should configure the oauth10a information for the OSLC Connector for Smartfacts # key used to encrypt the oauth10a configuration data oauth10aEncryptionKey: "" # define the key which is used to encrypt the oauth10a information in the database mailservice: enabled: false camp: enabled: false kafka: enabled: false
Replace the value of the domain property with your domain name.Replace
If your cluster has access to the internet, then you can pull the images directly from the registry provided by MID. In this case replace the value of the repologin property with the value provided from MID.
Replace the placeholder of the crtFullChain property with the content of the file
chain.crt.base64
.Replace the placeholder of the key property with the content of the
key.base64
file.Replace the placeholder for the externalUrls property with the URL of your Jama or Codebeamer instance. If you connect multiple instance delement instances, separate the URLs with a space.
Save the
values.yaml
file.
Install Smartfacts
Option: Use a private container registry
If your Kubernetes cluster has no access to the internet, you can pull the images from the MID registry, re-tag them and push them to your private registry.
Install Smartfacts
Execute the Installation
Enter the following command to execute the Installation:
Code Block |
---|
sudo helm upgrade --install --timeout 20m0s smartfacts mid-smartfacts/smartfacts -f values.yaml --version 4.67.5-genoslcv2 -n smartfacts --create-namespace |
Watch Deployment (in a new Session)
Open a second session on the server and enter the following command:
...
As soon as all deployments are available, the installation is ready.
Add Web Origin to Keycloak
Note |
---|
For Smartfacts to function, it is necessary to corret correct a value in the Keycloak configuration. |
...
Call this URL in a browser. Klick Click on “Administration Console” and log in with Username “keycloak-admin” and the password returned in the step above.
...
Scroll to the bottom of the page and klick click on the “save” button
A note on Smartfacts PoC Test Users
For the Smartfacts PoC you can use the generated test users “poc1”…”poc50”. All poc - users have the same password “poc”. For managing the test users in the CAMP use the account administrator user “acm” which has the password “acm”.
Create a Smartfacts Model Warehouse
Open the Smartfacts URL in your browser:
https://smartfacts.<yoursmartfactsdomain>
and log-in with the account manager credentials (user “acm”, password “acm”).You will now be asked to create a Model Warehouse.
Click on CREATE A NEW MODEL WAREHOUSE.
In the create dialog, first select the previously created account.
Provide a name for the Model Warehouse.
Optionally, activate the check box Create Demo Models if you want some demo content to be added to the Model Warehouse.
Model Warehouse creation is the final step in the Smartfacts platform set-up process.
Install the Plug-Ins
It depends on which tools you want to use in connection with Smartfacts. Smartfacts provides a plug-in plugin for every tool which is supported. You can download the plug-ins from the main menu via the command Get Plug-ins.
Troubleshooting
For general Kubernetes Troubleshooting you can consult the https://kubernetes.io/docs/reference/kubectl/cheatsheet/.
Detect running containers
Code Block |
---|
sudo kubectl -n smartfacts get pods |
Show
...
Code Block |
---|
sudo kubectl -n smartfacts logs <ContainerId> |
Show certtool logs
Show certtool output from Job
Code Block |
---|
sudo kubectl logs job.batch/smartfacts-certtool -c certtool -n smartfacts |
Show Secret written by certtool (Attention: The secret does not exist if the certtool did not succeed!)
Code Block |
---|
sudo kubectl get secret smartfacts-truststore -o 'go-template={{index .data "certtool.log"}}' -n smartfact |
Show Keycloak password
If it is necessary to login into the admin UI of Keycloak, the password for the admin user “keycloak-admin” can be optained by the following command.
...
the logs of a pod
With the following command you can get the log files of the Smartfacts platform (pod “sfit-platform”). If you deployed with a namespace named other than “smartfacts”, adjust the value of the second variable “ns”.
If you have to call “kubectl” with “sudo”:
Code Block |
---|
pod=genoslc ns=smartfacts sudo bash -c 'kubectl logs $(kubectl get pods -n $ns | grep $pod | cut -d " " -f1) -n $ns' |
If “sudo” is not required:
Code Block |
---|
pod=genoslc ns=smartfacts bash -c 'kubectl logs $(kubectl get pods -n $ns | grep $pod | cut -d " " -f1) -n $ns' |
If you need to get the logs of another pod, change the value of the variable “pod” at the beginning of the line. Available pod names for the Smartfacts installation are the following:
value for pod variable | POD |
---|---|
sfit-platform | The Smartfacts platform |
sfit-spa | The Smartfacts SPA |
mongodb | The mongodb database |
genoslc | The OSLC Connector for Smartfacts |
keycloak | The keycloak pod (identity provider for PoC installations with dummy users) |
Show certtool logs
Show certtool output from Job
Code Block |
---|
sudo kubectl logs job.batch/smartfacts-certtool -c certtool -n smartfacts |
Show Secret written by certtool (Attention: The secret does not exist if the certtool did not succeed!)
Code Block |
---|
sudo kubectl get secret smartfacts-truststore -o 'go-template={{index .data "KEYCLOAK_PASSWORDcerttool.log"}}' -n smartfacts | base64 -d; echo ""smartfact |
Show Keycloak password
If it is necessary to login into the admin UI of Keycloak, the password for the admin user “keycloak-admin” can be optained by the following command.
Code Block |
---|
sudo kubectl get secret smartfacts-keycloak-admin-secret -o 'go-template={{index .data "KEYCLOAK_PASSWORD"}}' -n smartfacts | base64 -d; echo "" |
Reset lost password for keycloak-admin user
In rare cases, it might happen that the password of the keycloak-admin user is different from the password in the secret “smartfacts-keycloak-admin-secret” and is not known anymore. This section describes the steps necessary to reset this password.
To reset the password for the keycloak-admin user:
Get the password from the secret like described in the section “Show Keycloak password” above. Save the password in a password manager.
Edit the secret “smartfacts-keycloak-admin-secret”, this command will open the secret in a vi editor:
Code Block sudo kubectl edit secret smartfacts-keycloak-admin-secret -n smartfacts
replace the value of the field “KEYCLOAK_USER” with the base64 value for “tmp-admin”: dG1wLWFkbWlu
Save and quit
Restart the keycloak pod:
Code Block pod=keycloak ns=smartfacts bash -c 'kubectl delete pod $(kubectl get pods -n $ns | grep $pod | cut -d " " -f1) -n $ns'
Sign in into the keycloak UI with the user “tmp-admin” and the password saved from the secret
In the Keycloak UI, switch to the realm “Master” and then to the section “users”
Klick on “View all users”
Klick on the ID of the user “keycloak-admin”
Go to section “Credentials” and insert the correct password in the fields in section “Reset Password”
Switch “Temprory” to “OFF”
Klick on “Reset Password” and confirm the Reset Password dialog
Log off of Keycloak
Edit the secret “smartfacts-keycloak-admin-secret” again
Code Block sudo kubectl edit secret smartfacts-keycloak-admin-secret -n smartfacts
replace the value of the field “KEYCLOAK_USER” with the base64 value for “keycloak-admin”: a2V5Y2xvYWstYWRtaW4=
Save and quit
Restart the keycloak pod
Code Block pod=keycloak ns=smartfacts bash -c 'kubectl delete pod $(kubectl get pods -n $ns | grep $pod | cut -d " " -f1) -n $ns'
Sign in into keycloak with keycloak-admin and the password saved from the secret
In the Keycloak UI switch to the realm “Master” and then to section “users”
Klick on “View all users”
Delete the user “tmp-admin”
log out of Keycloak
How to Move k3s data to another partition or disk
Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|
Postgres Password – How to Fix the "'global.postgresql.auth.postgresPassword' must not be empty" Error
During Smartfacts installation, some users may face an unexpected issue with Postgres, which is part of the Keycloak service. This issue may occur in different scenarios, such as syntax, certificate or repologin errors in a values.yaml file, network issues etc.
...