Lisa's Dev Setup Notes (updated 20210208 13:00)

Step 0: Preliminaries
Step 1: Clone AIG docker repo
~~Step 2: Clone AIG pbs repo & check out k8s_build branch~~
Step 3: Create a pbs repo clone to serve as your primary dev repo
Step 4: Add local directory specifications to configuration file
Step 5: Build & instantiate docker images
Step 6: Configure git
Step 7: Deploy PBS machines & ssh into PBS server host
Step 8: On PBS server host: build PBS
Step 9: On PBS server host: start PBS server and MOMs
Step 10: BURN EVERYTHING DOWN
(link to previous version of this document for archival purposes)

Step 0: Preliminaries

Launch a Docker daemon (provides platform for hosting the PBS dev server and MOMs)

Step 1: Clone AIG docker repo

The repo master contains AIG scripts to create a PBS test environment using Docker

monkeymonkeymonkeymonkey:mdeploy20201204 childers$ pwd
/Users/childers/code/resdocks/mdeploy20201204
monkeymonkeymonkeymonkey:mdeploy20201204 childers$ git clone [email protected]:AIG/pbs-docker.git
Cloning into 'pbs-docker'...
monkeymonkeymonkeymonkey:mdeploy20201204 childers$ ls pbs-docker/
docker-pbs-build.sh	docker-pbs-destroy.sh	docker-pbs-start.sh	docker-pbs-utils.sh.inc	pbsdev
docker-pbs-create.sh	docker-pbs-shell.sh	docker-pbs-stop.sh	docker-pbs.conf.example
monkeymonkeymonkeymonkey:mdeploy20201204 childers$

Note: if a 2-mom deployment is desired for testing purposes a prior version may be needed: git checkout 613ac61b58301991e3eb14ea3bdcc0c45ab6907a

Step 2: Clone AIG pbs repo & check out k8s_build branch

The "k8s_build" branch is used to acquire config files specifying how Docker should build containers for PBS machine hosts

monkeymonkeymonkeymonkey:mdeploy20201204 childers$ pwd /Users/childers/code/pbsdocks/mdeploy20201204 monkeymonkeymonkeymonkey:mdeploy20201204 childers$ mkdir pbspro_github_docker_builds monkeymonkeymonkeymonkey:mdeploy20201204 childers$ cd pbspro_github_docker_builds/ monkeymonkeymonkeymonkey:pbspro_github_docker_builds childers$ git clone [email protected]:ericpershey/pbspro.git Cloning into 'pbspro'... monkeymonkeymonkeymonkey:pbspro_github_docker_builds childers$ cd pbspro/ monkeymonkeymonkeymonkey:pbspro childers$ git checkout k8s_build Branch 'k8s_build' set up to track remote branch 'k8s_build' from 'origin'. Switched to a new branch 'k8s_build' monkeymonkeymonkeymonkey:pbspro childers$ ls CODE_OF_CONDUCT.md LICENSE autogen.sh doc openpbs.spec valgrind.supp CONTRIBUTING.md Makefile.am buildutils k8s openpbs.spec.in win_configure COPYRIGHT PBS_License.txt ci m4 src INSTALL README.md configure.ac openpbs-rpmlintrc test monkeymonkeymonkeymonkey:pbspro childers$

Step 3: Create a pbs repo clone to serve as your primary dev repo

Create a clone of your AIG dev repo; check out desired branch, if any

monkeymonkeymonkeymonkey:openpbs childers$ cd /Users/childers/code/resdocks/mdeploy20201204
monkeymonkeymonkeymonkey:mdeploy20201204 childers$ git clone [email protected]:monkeystate/openpbs.git
Cloning into 'openpbs'...
monkeymonkeymonkeymonkey:mdeploy20201204 childers$ ls
openpbs			pbs-docker

Step 4: Add local directory specifications to configuration file

Used by build, create, configure scripts to construct machine images; provided by AIG

monkeymonkeymonkeymonkey:~ childers$ cd /Users/childers/code/resdocks/mdeploy20201204/pbs-docker
monkeymonkeymonkeymonkey:pbs-docker childers$ cat docker-pbs.conf
#
# This config file is sourced by Bash scripts and thus must adhere to proper
# Bash syntax.  That said, environment variables may be referenced and
# programs run to determine the values of the configuration variables.
#
# The configuration variables must be set as environment variables since they
# are some are pushed into the Docker environment.  In other words, do remove
# the "export" keyword.
#

# Change this to your Docker Hub user account if you have one
export CV2_DOCKER_HUB_USER=$USER

# Set this to "true" if you are running on a machine where you are the only
# user such as your laptop
export CV2_RUNNING_ON_SINGLE_USER_MACHINE=true

# The location on the local machine of the PBS source tree to build against
export CV2_DOCKER_PBS_SOURCE_DIR=$HOME/code/resdocks/mdeploy20201204/openpbs

# This is the base OS used for the build.
export CV2_BASE_OS=centos7

# Number of MOM nodes (server and MOM will share a node if set to '0')
export CV2_PBS_NUM_MOMS=2

# The purpose of the development container (branch name, etc.).  This will be
# included in the container name and may be left empty.
export CV2_DOCKER_CONTAINER_PURPOSE=mky2
monkeymonkeymonkeymonkey:pbs-docker childers$

Step 5: Build & instantiate docker images

Create machines from scratch using files from above repos; helper scripts provided by AIG

monkeymonkeymonkeymonkey:pbs-docker childers$ cd /Users/childers/code/resdocks/mdeploy20201204/pbs-docker
monkeymonkeymonkeymonkey:pbs-docker childers$ ./docker-pbs-build.sh && ./docker-pbs-create.sh
(link to docker build log)

If you receive the following error (on MacOs):

monkeymonkeymonkeymonkey:pbs-docker childers$ ./docker-pbs-build.sh
Info: Building PBS Docker base OS image for childers/pbspro-centos7-base
./docker-pbs-utils.sh.inc: line 14: realpath: command not found

You can use brew to install realpath:

monkeymonkeymonkeymonkey:pbs-docker childers$ brew install coreutils
Updating Homebrew...

Step 6: Configure git

Configure global git settings

To see current global configuration: cat ~/.gitconfig
See configuration instructions if needed

Configure local git settings in the primary dev repo

cd to the primary dev repo created in Step 3
Check current local git configuration: git branch -v -r
Set up remote branches as desired; one approach:

Rename local name of the primary dev repoo and add altair's openpbs repo:

git remote rename origin github-monkeystate
git remote add upstream [email protected]:openpbs/openpbs.git
git pull upstream

Edit local git config:

"remote = upstream": git pulls from the altair openpbs repo
"pushurl = [email protected]:monkeystate/openpbs.git": git pushes to the primary dev repo

monkeymonkeymonkeymonkey:openpbs childers$ cat .git/config
[core]
	repositoryformatversion = 0
	filemode = true
	bare = false
	logallrefupdates = true
	ignorecase = true
	precomposeunicode = true
[remote "github-monkeystate"]
	url = [email protected]:monkeystate/openpbs.git
	fetch = +refs/heads/*:refs/remotes/github-monkeystate/*
[branch "master"]
	remote = upstream
	merge = refs/heads/master
[remote "upstream"]
	url = [email protected]:openpbs/openpbs.git
	fetch = +refs/heads/*:refs/remotes/upstream/*
	pushurl = [email protected]:monkeystate/openpbs.git

monkeymonkeymonkeymonkey:openpbs childers$ git remote -v
github-monkeystate	[email protected]:monkeystate/openpbs.git (fetch)
github-monkeystate	[email protected]:monkeystate/openpbs.git (push)
upstream	[email protected]:openpbs/openpbs.git (fetch)
upstream	[email protected]:monkeystate/openpbs.git (push)

Update remote and local github-monkeystate masters

git push
git fetch github-monkeystate

Step 7: Deploy PBS machines & ssh into PBS server host

Helper scripts provided by AIG

monkeymonkeymonkeymonkey:pbs-docker childers$ pwd
/Users/childers/code/resdocks/mdeploy20201204/pbs-docker
monkeymonkeymonkeymonkey:pbs-docker childers$ ./docker-pbs-start.sh && ./docker-pbs-shell.sh
Info: Starting container pbsdev-centos7-ns2-server
Info: Starting container pbsdev-centos7-ns2-mom1
Info: Starting container pbsdev-centos7-ns2-mom2
Info: Starting shell on container pbsdev-centos7-ns2-server
[07/25 18:23:40] pbsdev@pbsdev-centos7-ns2-server:~ 5%

Step 8: On PBS server host: build PBS

Helper scripts provided by AIG

[07/25 18:23:40] pbsdev@pbsdev-centos7-ns2-server:~ 5% pbsdev-build.sh
(link to pbsdev build log)

Step 9: On PBS server host: start PBS server and MOMs

Helper scripts provided by AIG

[07/25 18:32:00] pbsdev@pbsdev-centos7-ns2-server:~ 6% pbsdev-start.sh
[07/25 18:37:27] pbsdev@pbsdev-centos7-ns2-server:~ 7% ps aux | grep pbs
pbsdev      14  0.0  0.1  11836  2976 pts/0    Ss   18:23   0:00 bash
root     21625  0.0  0.1 345588  2124 ?        Ssl  18:37   0:00 /opt/pbs/sbin/pbs_comm
root     21631  0.0  0.4 180392  8416 ?        Ssl  18:37   0:00 /opt/pbs/sbin/pbs_sched
root     21932  0.0  0.1  72608  2356 ?        Ss   18:37   0:00 /opt/pbs/sbin/pbs_ds_monitor monitor
postgres 21989  0.0  0.6 133100 13748 ?        S    18:37   0:00 /usr/bin/postgres -D /var/spool/pbs/datastore -p 15007
postgres 22008  0.0  0.6 137872 12980 ?        Ss   18:37   0:00 postgres: postgres pbs_datastore 172.21.0.2(57634) idle
root     22009  0.0  0.6 253404 14000 ?        Ssl  18:37   0:00 /opt/pbs/sbin/pbs_server.bin
pbsdev   22035  0.0  0.1  51768  3496 pts/0    R+   18:41   0:00 ps aux
pbsdev   22036  0.0  0.0   9104   916 pts/0    S+   18:41   0:00 grep pbs
[07/25 18:41:11] pbsdev@pbsdev-centos7-ns2-server:~ 8%
(link to pbsdev start log)

Step 10: BURN EVERYTHING DOWN

Helper scripts provided by AIG

monkeymonkeymonkeymonkey:pbs-docker childers$ pwd
/Users/childers/code/resdocks/mdeploy20201204/pbs-docker
monkeymonkeymonkeymonkey:pbs-docker childers$ ./docker-pbs-stop.sh && ./docker-pbs-destroy.sh
Info: Stopping Docker container pbsdev-centos7-ns2-server
Info: Stopping Docker container pbsdev-centos7-ns2-mom1
Info: Stopping Docker container pbsdev-centos7-ns2-mom2
Info: Destroying Docker container pbsdev-centos7-ns2-server
Info: Destroying Docker container pbsdev-centos7-ns2-mom1
Info: Destroying Docker container pbsdev-centos7-ns2-mom2
Info: Destroying Docker volume pbsdev-centos7-ns2-vol-build for shared /home
Info: Destroying Docker volume pbsdev-centos7-ns2-vol-opt for shared /opt
Info: Destroying Docker network pbsdev-centos7-ns2.local
monkeymonkeymonkeymonkey:pbs-docker childers$