Lisa's Dev Setup Notes (updated 20200619 23:58)

• Step 0: Launch Docker daemon
• Step 1: Clone AIG docker repo
• Step 2: Clone AIG vagrant repo
• Step 3: Clone AIG pbs repo & check out k8s_build branch
• Step 4: Create a second AIG pbs repo clone (to serve as primary dev repo) & check out desired branch, if any
• Step 5: Add local directory specifications to configuration file
• Step 6: Build & instantiate docker images
• Step 7: Run autogen in primary dev repo
• Step 8: Deploy PBS machines & ssh into PBS server host
• Step 9: On PBS server host: build PBS
• Step 10: On PBS server host: start PBS server and MOMs
• Step 11: BURN EVERYTHING DOWN

Step 0: Launch Docker daemon

• Platform for hosting the PBS dev server and MOMs

Step 1: Clone AIG docker repo

• The repo master contains AIG scripts to create a PBS test environment using Docker

• monkeymonkeymonkeymonkey:code childers$ pwd
  /Users/childers/code
  monkeymonkeymonkeymonkey:code childers$ git clone [email protected]:AIG/pbs-docker.git
  Cloning into 'pbs-docker'...
  monkeymonkeymonkeymonkey:code childers$ ls pbs-docker/
  docker-pbs-build.sh	docker-pbs-destroy.sh	docker-pbs-start.sh	docker-pbs-utils.sh.inc	docker-pbs.conf.example
  docker-pbs-create.sh	docker-pbs-shell.sh	docker-pbs-stop.sh	docker-pbs.conf		pbsdev
  

Step 2: Clone AIG vagrant repo

• The repo master contains AIG test hooks to be deployed in the PBS server

• monkeymonkeymonkeymonkey:code childers$ pwd
  /Users/childers/code
  monkeymonkeymonkeymonkey:code childers$ git clone [email protected]:AIG/cv2-prototypes/pbs-vagrant.git
  Cloning into 'pbs-vagrant'...
  monkeymonkeymonkeymonkey:code childers$ ls pbs-vagrant/
  README.md			atp				templates
  Vagrantfile			provisioners			vagrant-gen-host-keys.sh
  

Step 3: Clone AIG pbs repo & check out k8s_build branch

• The "k8s_build" branch is used to acquire config files specifying how Docker should build containers for PBS machine hosts

• monkeymonkeymonkeymonkey:code childers$ pwd
  /Users/childers/code
  monkeymonkeymonkeymonkey:code childers$ mkdir pbspro_github_docker_builds
  monkeymonkeymonkeymonkey:code childers$ cd pbspro_github_docker_builds/
  monkeymonkeymonkeymonkey:pbspro_github_docker_builds childers$ git clone https://github.com/ericpershey/pbspro.git
  Cloning into 'pbspro'...
  monkeymonkeymonkeymonkey:pbspro_github_docker_builds childers$ cd pbspro/
  monkeymonkeymonkeymonkey:pbspro childers$ git checkout k8s_build
  Branch 'k8s_build' set up to track remote branch 'k8s_build' from 'origin'.
  Switched to a new branch 'k8s_build'
  monkeymonkeymonkeymonkey:pbspro childers$ ls
  CODE_OF_CONDUCT.md	Makefile.am		autogen.sh		configure.ac		openpbs.spec		win_configure
  CONTRIBUTING.md		Makefile.in		autom4te.cache		doc			openpbs.spec.in
  COPYRIGHT		PBS_License.txt		buildutils		k8s			src
  INSTALL			README.md		ci			m4			test
  LICENSE			aclocal.m4		configure		openpbs-rpmlintrc	valgrind.supp
  

Step 4: Create a second AIG pbs repo clone (to serve as primary dev repo) & check out desired branch, if any

• Contains AIG WIP code; to deploy node state additions check out the "hook_node_state" branch

• monkeymonkeymonkeymonkey:pbspro childers$ cd
  monkeymonkeymonkeymonkey:~ childers$ cd code/
  monkeymonkeymonkeymonkey:code childers$ mkdir pbspro
  monkeymonkeymonkeymonkey:code childers$ cd pbspro
  monkeymonkeymonkeymonkey:pbspro childers$ git clone https://github.com/ericpershey/pbspro.git
  Cloning into 'pbspro'...
  

Step 5: Add local directory specifications to configuration file

• Used by build, create, configure scripts to construct machine images; provided by AIG

• monkeymonkeymonkeymonkey:pbs-docker childers$ pwd
  /Users/childers/code/pbs-docker
  monkeymonkeymonkeymonkey:pbs-docker childers$ cat docker-pbs.conf
  export CV2_DOCKER_HUB_USER=$USER
  export CV2_DOCKER_PBS_K8S_CLONE_DIR=$HOME/code/pbspro_github_docker_builds/pbspro
  export CV2_DOCKER_PBS_SOURCE_DIR=$HOME/code/pbspro/pbspro/
  export CV2_DOCKER_CONTAINER_PURPOSE=
  export CV2_BASE_OS=centos7
  export CV2_PBS_NUM_MOMS=2
  monkeymonkeymonkeymonkey:pbs-docker childers$
  

Step 6: Build & instantiate docker images

• Create machines from scratch using files from above repos; helper scripts provided by AIG

• cd /Users/childers/code/pbs-docker
  ./docker-pbs-build.sh && ./docker-pbs-create.sh
  

Step 7: Run autogen in primary dev repo

• Used to configure PBS build (need to rerun after every branch checkout in the primary dev repo); provided by Altair

• monkeymonkeymonkeymonkey:pbspro childers$ pwd
  /Users/childers/code/pbspro/pbspro
  monkeymonkeymonkeymonkey:pbspro childers$ ./autogen.sh
  

Step 8: Deploy PBS machines & ssh into PBS server host

• Helper scripts provided by AIG

• cd /Users/childers/code/pbs-docker
  ./docker-pbs-start.sh && ./docker-pbs-shell.sh
  

Step 9: On PBS server host: build PBS

• Helper scripts provided by AIG

• [06/18 16:32:19] pbsdev@pbsdev-centos7-server:~ 5% pbsdev-build.sh
  

Step 10: On PBS server host: start PBS server and MOMs

• Helper scripts provided by AIG

• [06/18 16:35:19] pbsdev@pbsdev-centos7-server:~ 8% pbsdev-start.sh
  Info: Starting PBS on node server
  Starting PBS
  PBS Home directory /var/spool/pbs needs updating.
  Running /opt/pbs/libexec/pbs_habitat to update it.
  ***
  *** Setting default queue and resource limits.
  ***
  Connecting to PBS dataservice.....connected to PBS dataservice@pbsdev-centos7-server
  *** End of /opt/pbs/libexec/pbs_habitat
  Home directory /var/spool/pbs updated.
  /opt/pbs/sbin/pbs_comm ready (pid=21635), Proxy Name:pbsdev-centos7-server.pbsdev-centos7.local:17001, Threads:4
  PBS comm
  PBS sched
  Connecting to PBS dataservice.....connected to PBS dataservice@pbsdev-centos7-server
  Licenses valid for 10000000 Floating hosts
  PBS server
  Info: Starting PBS on node mom1
  Starting PBS
  PBS Home directory /var/spool/pbs needs updating.
  Running /opt/pbs/libexec/pbs_habitat to update it.
  ***
  *** End of /opt/pbs/libexec/pbs_habitat
  Home directory /var/spool/pbs updated.
  PBS mom
  Info: Starting PBS on node mom2
  Starting PBS
  PBS Home directory /var/spool/pbs needs updating.
  Running /opt/pbs/libexec/pbs_habitat to update it.
  ***
  *** End of /opt/pbs/libexec/pbs_habitat
  Home directory /var/spool/pbs updated.
  PBS mom
  Info: Registering node pbsdev-centos7-mom1 with PBS
  Info: Registering node pbsdev-centos7-mom2 with PBS
  pbsdev-centos7-mom1
       Mom = pbsdev-centos7-mom1.pbsdev-centos7.local
       ntype = PBS
       state = state-unknown,down
       resources_available.host = pbsdev-centos7-mom1
       resources_available.vnode = pbsdev-centos7-mom1
       resources_assigned.accelerator_memory = 0kb
       resources_assigned.hbmem = 0kb
       resources_assigned.mem = 0kb
       resources_assigned.naccelerators = 0
       resources_assigned.ncpus = 0
       resources_assigned.vmem = 0kb
       resv_enable = True
       sharing = default_shared
  
  pbsdev-centos7-mom2
       Mom = pbsdev-centos7-mom2.pbsdev-centos7.local
       ntype = PBS
       state = state-unknown,down
       resources_available.host = pbsdev-centos7-mom2
       resources_available.vnode = pbsdev-centos7-mom2
       resources_assigned.accelerator_memory = 0kb
       resources_assigned.hbmem = 0kb
       resources_assigned.mem = 0kb
       resources_assigned.naccelerators = 0
       resources_assigned.ncpus = 0
       resources_assigned.vmem = 0kb
       resv_enable = True
       sharing = default_shared
  
  [06/18 16:36:09] pbsdev@pbsdev-centos7-server:~ 9% qmgr --version
  pbs_version = 19.1.1.726.g4217c92
  [06/18 17:36:26] pbsdev@pbsdev-centos7-server:~ 10%
  

Step 11: BURN EVERYTHING DOWN

• Helper scripts provided by AIG

• cd /Users/childers/code/pbs-docker
  ./docker-pbs-stop.sh && ./docker-pbs-destroy.sh