본문 바로가기
[OpenSource | backend.ai]

[OpenSource | backend.ai] 4. Install backend.ai with sh file, (error solving)

Haesanmul 2020. 9. 4. 16:00
728x90

 

< Install Backend.ai in Local Env. >

 

로컬에 backend.ai를 설치하는 방법을 소개한다.

나는 WSL2를 사용하다가 여러가지 이유(dock port, env path, etc)로 mac으로 회귀하였다...........

github.com/lablup/backend.ai

 

lablup/backend.ai

Backend.AI is a streamlined, container-based computing cluster orchestrator that hosts diverse programming languages and popular computing/ML frameworks, with pluggable heterogeneous accelerator su...

github.com

lablup/backend.ai > Scripts > install-dev.sh 가 있다.  raw file을 wget으로 가져와 보자.

wget https://raw.githubusercontent.com/lablup/backend.ai/master/scripts/install-dev.sh

마찬가지 delete-dev.sh파일도 마찬가지로 가지고 온다. 다음 내용은 install-dev 파일의 전문이다. 데코레이션들이 같이 들어있다. 설치파일을 이해하는데도 꽤나 오랜 시간이 걸렸다.

#! /bin/bash

# Set "echo -e" as default
shopt -s xpg_echo

RED="\033[0;91m"
GREEN="\033[0;92m"
YELLOW="\033[0;93m"
BLUE="\033[0;94m"
CYAN="\033[0;96m"
WHITE="\033[0;97m"
LRED="\033[1;31m"
LGREEN="\033[1;32m"
LYELLOW="\033[1;33m"
LBLUE="\033[1;34m"
LCYAN="\033[1;36m"
LWHITE="\033[1;37m"
LG="\033[0;37m"
NC="\033[0m"
REWRITELN="\033[A\r\033[K"

readlinkf() {
  $bpython -c "import os,sys; print(os.path.realpath(os.path.expanduser(sys.argv[1])))" "${1}"
}

sed_inplace() {
  # BSD sed and GNU sed implements the "-i" option differently.
  case "$OSTYPE" in
    darwin*) sed -i '' "$@" ;;
    bsd*) sed -i '' "$@" ;;
    *) sed -i "$@" ;;
  esac
}

trim() {
  echo "$1" | sed -e 's/^[[:space:]]*//g' -e 's/[[:space:]]*$//g'
}

usage() {
  echo "${GREEN}Backend.AI Development Setup${NC}: ${CYAN}Auto-installer Tool${NC}"
  echo ""
  echo "${LWHITE}USAGE${NC}"
  echo "  $0 ${LWHITE}[OPTIONS]${NC}"
  echo ""
  echo "${LWHITE}OPTIONS${NC}"
  echo "  ${LWHITE}-h, --help${NC}           Show this help message and exit"
  echo ""
  echo "  ${LWHITE}-e, --env ENVID${NC}"
  echo "                       Manually override the environment ID to use"
  echo "                       (default: random-generated)"
  echo ""
  echo "  ${LWHITE}--python-version VERSION${NC}"
  echo "                       Set the Python version to install via pyenv"
  echo "                       (default: 3.8.3)"
  echo ""
  echo "  ${LWHITE}--install-path PATH${NC}  Set the target directory"
  echo "                       (default: ./backend.ai-dev)"
  echo ""
  echo "  ${LWHITE}--server-branch NAME${NC}"
  echo "                       The branch of git clones for server components"
  echo "                       (default: master)"
  echo ""
  echo "  ${LWHITE}--client-branch NAME${NC}"
  echo "                       The branch of git clones for client components"
  echo "                       (default: master)"
  echo ""
  echo "  ${LWHITE}--enable-cuda${NC}        Install CUDA accelerator plugin and pull a"
  echo "                       TenosrFlow CUDA kernel for testing/demo."
  echo "                       (default: false)"
  echo ""
  echo "  ${LWHITE}--cuda-branch NAME${NC}   The branch of git clone for the CUDA accelerator "
  echo "                       plugin; only valid if ${LWHITE}--enable-cuda${NC} is specified."
  echo "                       (default: master)"
  echo ""
  echo "  ${LWHITE}--postgres-port PORT${NC} The port to bind the PostgreSQL container service."
  echo "                       (default: 8100)"
  echo ""
  echo "  ${LWHITE}--redis-port PORT${NC}    The port to bind the Redis container service."
  echo "                       (default: 8110)"
  echo ""
  echo "  ${LWHITE}--etcd-port PORT${NC}     The port to bind the etcd container service."
  echo "                       (default: 8120)"
  echo ""
  echo "  ${LWHITE}--manager-port PORT${NC}  The port to expose the manager API service."
  echo "                       (default: 8081)"
  echo ""
  echo "  ${LWHITE}--agent-rpc-port PORT${NC}"
  echo "                       The port for the manager-to-agent RPC calls."
  echo "                       (default: 6001)"
  echo ""
  echo "  ${LWHITE}--agent-watcher-port PORT${NC}"
  echo "                       The port for the agent's watcher service."
  echo "                       (default: 6009)"
}

show_error() {
  echo " "
  echo "${RED}[ERROR]${NC} ${LRED}$1${NC}"
}

show_warning() {
  echo " "
  echo "${YELLOW}[ERROR]${NC} ${LYELLOW}$1${NC}"
}

show_info() {
  echo " "
  echo "${BLUE}[INFO]${NC} ${GREEN}$1${NC}"
}

show_note() {
  echo " "
  echo "${BLUE}[NOTE]${NC} $1"
}

show_important_note() {
  echo " "
  echo "${LRED}[NOTE]${NC} $1"
}

has_python() {
  "$1" -c '' >/dev/null 2>&1
  if [ "$?" -eq 127 ]; then
    echo 0
  else
    echo 1
  fi
}

if [[ "$OSTYPE" == "linux-gnu" ]]; then
  if [ $(id -u) = "0" ]; then
    docker_sudo=''
  else
    docker_sudo='sudo'
  fi
else
  docker_sudo=''
fi
if [ $(id -u) = "0" ]; then
  sudo=''
else
  sudo='sudo'
fi

# Detect distribution 설치하는 루틴이 나타나 있다. 
KNOWN_DISTRO="(Debian|Ubuntu|RedHat|CentOS|openSUSE|Amazon|Arista|SUSE)"
DISTRO=$(lsb_release -d 2>/dev/null | grep -Eo $KNOWN_DISTRO  || grep -Eo $KNOWN_DISTRO /etc/issue 2>/dev/null || uname -s)

if [ $DISTRO = "Darwin" ]; then
  DISTRO="Darwin"
elif [ -f /etc/debian_version -o "$DISTRO" == "Debian" -o "$DISTRO" == "Ubuntu" ]; then
  DISTRO="Debian"
elif [ -f /etc/redhat-release -o "$DISTRO" == "RedHat" -o "$DISTRO" == "CentOS" -o "$DISTRO" == "Amazon" ]; then
  DISTRO="RedHat"
elif [ -f /etc/system-release -o "$DISTRO" == "Amazon" ]; then
  DISTRO="RedHat"
else
  show_error "Sorry, your host OS distribution is not supported by this script."
  show_info "Please send us a pull request or file an issue to support your environment!"
  exit 1
fi
if [ $(has_python "python") -eq 1 ]; then
  bpython=$(which "python")
elif [ $(has_python "python3") -eq 1 ]; then
  bpython=$(which "python3")
elif [ $(has_python "python2") -eq 1 ]; then
  bpython=$(which "python2")
else
  # Ensure "readlinkf" is working...
  show_error "python (for bootstrapping) is not available!"
  show_info "This script assumes Python 2.7+/3+ is already available on your system."
  exit 1
fi

ROOT_PATH=$(pwd)
ENV_ID=""
PYTHON_VERSION="3.8.3"
SERVER_BRANCH="master"
CLIENT_BRANCH="master"
INSTALL_PATH="./backend.ai-dev"
DOWNLOAD_BIG_IMAGES=0
ENABLE_CUDA=0
CUDA_BRANCH="master"
# POSTGRES_PORT="8100"
# REDIS_PORT="8110"
# ETCD_PORT="8120"
# MANAGER_PORT="8081"
# CONSOLE_SERVER_PORT="8080"
# AGENT_RPC_PORT="6001"
# AGENT_WATCHER_PORT="6009"
# VFOLDER_REL_PATH="vfolder/local"
# LOCAL_STORAGE_PROXY="local"
# LOCAL_STORAGE_VOLUME="volume1"

POSTGRES_PORT="8101"
REDIS_PORT="8111"
ETCD_PORT="8121"
MANAGER_PORT="8091"
CONSOLE_SERVER_PORT="8090"
AGENT_RPC_PORT="6011"
AGENT_WATCHER_PORT="6019"
VFOLDER_REL_PATH="vfolder/local"
LOCAL_STORAGE_PROXY="local"
LOCAL_STORAGE_VOLUME="volume1"

while [ $# -gt 0 ]; do
  case $1 in
    -h | --help)           usage; exit 1 ;;
    -e | --env)            ENV_ID=$2; shift ;;
    --env=*)               ENV_ID="${1#*=}" ;;
    --python-version)      PYTHON_VERSION=$2; shift ;;
    --python-version=*)    PYTHON_VERSION="${1#*=}" ;;
    --install-path)        INSTALL_PATH=$2; shift ;;
    --install-path=*)      INSTALL_PATH="${1#*=}" ;;
    --server-branch)       SERVER_BRANCH=$2; shift ;;
    --server-branch=*)     SERVER_BRANCH="${1#*=}" ;;
    --client-branch)       CLIENT_BRANCH=$2; shift ;;
    --client-branch=*)     CLIENT_BRANCH="${1#*=}" ;;
    --enable-cuda)         ENABLE_CUDA=1 ;;
    --download-big-images) DOWNLOAD_BIG_IMAGES=1 ;;
    --cuda-branch)         CUDA_BRANCH=$2; shift ;;
    --cuda-branch=*)       CUDA_BRANCH="${1#*=}" ;;
    --postgres-port)       POSTGRES_PORT=$2; shift ;;
    --postgres-port=*)     POSTGRES_PORT="${1#*=}" ;;
    --redis-port)          REDIS_PORT=$2; shift ;;
    --redis-port=*)        REDIS_PORT="${1#*=}" ;;
    --etcd-port)           ETCD_PORT=$2; shift ;;
    --etcd-port=*)         ETCD_PORT="${1#*=}" ;;
    --manager-port)         MANAGER_PORT=$2; shift ;;
    --manager-port=*)       MANAGER_PORT="${1#*=}" ;;
    --console-server-port)         CONSOLE_SERVER_PORT=$2; shift ;;
    --console-server-port=*)       CONSOLE_SERVER_PORT="${1#*=}" ;;
    --agent-rpc-port)       AGENT_RPC_PORT=$2; shift ;;
    --agent-rpc-port=*)     AGENT_RPC_PORT="${1#*=}" ;;
    --agent-watcher-port)   AGENT_WATCHER_PORT=$2; shift ;;
    --agent-watcher-port=*) AGENT_WATCHER_PORT="${1#*=}" ;;
    *)
      echo "Unknown option: $1"
      echo "Run '$0 --help' for usage."
      exit 1
  esac
  shift
done
INSTALL_PATH=$(readlinkf "$INSTALL_PATH")

# 각 운영체제별로 적절한 인스톨러가 사용되어 있었다. 
install_brew() {
    case $DISTRO in
	Darwin)
	    if ! type "brew" > /dev/null 2>&1; then
	        show_info "try to support auto-install on macOS using Homebrew."
		/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
	    fi
    esac
}
install_script_deps() {
  case $DISTRO in
  Debian)
    $sudo apt-get update
    $sudo apt-get install -y git
    ;;
  RedHat)
    $sudo yum clean expire-cache  # next yum invocation will update package metadata cache
    $sudo yum install -y git
    ;;
  Darwin)
    if ! type "brew" >/dev/null 2>&1; then
      show_error "brew is not available!"
      show_info "Sorry, we only support auto-install on macOS using Homebrew. Please install it and try again."
      install_brew
    fi
    brew update
    # Having Homebrew means that the user already has git.
    ;;
  esac
}

install_pybuild_deps() {
  case $DISTRO in
  Debian)
    $sudo apt-get install -y libssl-dev libreadline-dev libgdbm-dev zlib1g-dev libbz2-dev libsqlite3-dev libffi-dev liblzma-dev
    ;;
  RedHat)
    $sudo yum install -y openssl-devel readline-devel gdbm-devel zlib-devel bzip2-devel libsqlite-devel libffi-devel lzma-devel
    ;;
  Darwin)
    brew install openssl
    brew install readline
    brew install zlib xz
    brew install sqlite3 gdbm
    brew install tcl-tk
    ;;
  esac
}

#backend.ai의 이미지를 설치할 때, 깃에서 큰 파일들이 있으면 lfs로 받아와야 한다. 
install_git_lfs() {
  case $DISTRO in
  Debian)
    $sudo apt-get install -y git-lfs
    ;;
  RedHat)
    curl -s https://packagecloud.io/install/repositories/github/git-lfs/script.rpm.sh | $sudo bash
    $sudo yum install -y git-lfs
    ;;
  Darwin)
    brew install git-lfs
    ;;
  esac
  git lfs install
}

install_system_pkg() {
  # accepts three args: Debian-style name, RedHat-style name, and Homebrew-style name
  case $DISTRO in
  Debian)
    $sudo apt-get install -y $1
    ;;
  RedHat)
    $sudo yum install -y $2
    ;;
  Darwin)
    brew install $3
  esac
}

install_docker() {
  show_info "Install docker"
  case $DISTRO in
  Debian)
    sudo curl -fsSL https://get.docker.io | bash
    sudo usermod -aG docker $(whoami)
    ;;
  RedHat)
    sudo curl -fsSL https://get.docker.io | bash
    sudo usermod -aG docker $(whoami)
    ;;
  Darwin)
    show_info "Please install the latest version of docker and try again."
    show_info "It should have been installed with Docker Desktop for Mac or Docker Toolbox."
    show_info " - Instructions: https://docs.docker.com/install/"
    show_info"  - Download: https://download.docker.com/mac/stable/Docker.dmg"
    exit 1
    ;;
  esac
}

install_docker_compose() { # 도커 compose 유틸리티 추가
  show_info "Install docker-compose"
  case $DISTRO in
  Debian)
    sudo curl -L "https://github.com/docker/compose/releases/download/1.24.1/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
    sudo chmod +x /usr/local/bin/docker-compose
    ;;
  RedHat)
    sudo curl -L "https://github.com/docker/compose/releases/download/1.24.1/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
    sudo chmod +x /usr/local/bin/docker-compose
    ;;
  Darwin)
    show_info "Please install the latest version of docker-compose and try again."
    show_info "It should have been installed with Docker Desktop for Mac or Docker Toolbox."
    show_info " - Instructions: https://docs.docker.com/compose/install/"
    show_info"  - Download: https://download.docker.com/mac/stable/Docker.dmg"
    exit 1
    ;;
  esac
}

install_python() {
  if [ -z "$(pyenv versions | grep -E "^\\*?[[:space:]]+${PYTHON_VERSION//./\\.}([[:blank:]]+.*)?$")" ]; then
    if [ "$DISTRO" = "Darwin" ]; then
      export PYTHON_CONFIGURE_OPTS="--enable-framework --with-tcl-tk"
      local _prefix_openssl="$(brew --prefix openssl)"
      local _prefix_sqlite3="$(brew --prefix sqlite3)"
      local _prefix_readline="$(brew --prefix readline)"
      local _prefix_zlib="$(brew --prefix zlib)"
      local _prefix_gdbm="$(brew --prefix gdbm)"
      local _prefix_tcltk="$(brew --prefix tcl-tk)"
      local _prefix_xz="$(brew --prefix xz)"
      export CFLAGS="-I${_prefix_openssl}/include -I${_prefix_sqlite3}/include -I${_prefix_readline}/include -I${_prefix_zlib}/include -I${_prefix_gdbm}/include -I${_prefix_tcltk}/include -I${_prefix_xz}/include"
      export LDFLAGS="-L${_prefix_openssl}/lib -L${_prefix_sqlite3}/lib -L${_prefix_readline}/lib -L${_prefix_zlib}/lib -L${_prefix_gdbm}/lib -L${_prefix_tcltk}/lib -L${_prefix_xz}/lib"
    fi
    pyenv install --skip-existing "${PYTHON_VERSION}"
    if [ "$DISTRO" = "Darwin" ]; then
      unset PYTHON_CONFIGURE_OPTS
      unset CFLAGS
      unset LDFLAGS
    fi
    if [ $? -ne 0 ]; then
      show_error "Installing the Python version ${PYTHON_VERSION} via pyenv has failed."
      show_note "${PYTHON_VERSION} is not supported by your current installation of pyenv."
      show_note "Please update pyenv or lower PYTHON_VERSION in install-dev.sh script."
      exit 1
    fi
  else
    echo "${PYTHON_VERSION} is already installed."
  fi
}

check_python() {
  pyenv shell "${PYTHON_VERSION}"
  local _pyprefix=$(python -c 'import sys; print(sys.prefix, end="")')
  python -c 'import ssl' > /dev/null 2>&1 /dev/null
  if [ $? -ne 0 ]; then
    show_error "Your Python (prefix: ${_pyprefix}) is missing SSL support. Please reinstall or rebuild it."
    exit 1
  else
    echo "SSL support: ok"
  fi
  python -c 'import lzma' > /dev/null 2>&1 /dev/null
  if [ $? -ne 0 ]; then
    show_error "Your Python (prefix: ${_pyprefix}) is missing LZMA (XZ) support. Please reinstall or rebuild it."
    exit 1
  else
    echo "LZMA support: ok"
  fi
  pyenv shell --unset
}

# BEGIN!

echo " "
echo "${LGREEN}Backend.AI one-line installer for developers${NC}"

# NOTE: docker-compose enforces lower-cased project names
if [ -z "${ENV_ID}" ]; then
  ENV_ID=$(LC_ALL=C tr -dc 'a-z0-9' < /dev/urandom | head -c 8)
fi
show_note "Your environment ID is ${YELLOW}${ENV_ID}${NC}."

# Check prerequisites
show_info "Checking prerequisites and script dependencies..."
install_script_deps
if ! type "docker" >/dev/null 2>&1; then
  show_warning "docker is not available; trying to install it automatically..."
  install_docker
fi
if ! type "docker-compose" >/dev/null 2>&1; then
  show_warning "docker-compose is not available; trying to install it automatically..."
  install_docker_compose
fi
if [ "$DISTRO" = "Darwin" ]; then
  echo "validating Docker Desktop mount permissions..."
  docker pull alpine:3.8 > /dev/null
  docker run --rm -v "$HOME/.pyenv:/root/vol" alpine:3.8 ls /root/vol > /dev/null 2>&1
  if [ $? -ne 0 ]; then
    # backend.ai-krunner-DISTRO pkgs are installed in pyenv's virtualenv,
    # so ~/.pyenv must be mountable.
    show_error "You must allow mount of '$HOME/.pyenv' in the File Sharing preference of the Docker Desktop app."
    exit 1
  fi
  docker run --rm -v "$INSTALL_PATH:/root/vol" alpine:3.8 ls /root/vol > /dev/null 2>&1
  if [ $? -ne 0 ]; then
    show_error "You must allow mount of '$INSTALL_PATH' in the File Sharing preference of the Docker Desktop app."
    exit 1
  fi
  echo "${REWRITELN}validating Docker Desktop mount permissions: ok"
fi

# Install pyenv
read -r -d '' pyenv_init_script <<"EOS"
export PYENV_ROOT="$HOME/.pyenv"
export PATH="$PYENV_ROOT/bin:$PATH"
eval "$(pyenv init -)"
eval "$(pyenv virtualenv-init -)"
EOS
if ! type "pyenv" >/dev/null 2>&1; then
  # TODO: ask if install pyenv
  show_info "Installing pyenv..."
  set -e
  curl https://pyenv.run | sh
  for PROFILE_FILE in "zshrc" "bashrc" "profile" "bash_profile"
  do
    if [ -e "${HOME}/.${PROFILE_FILE}" ]
    then
      echo "$pyenv_init_script" >> "${HOME}/.${PROFILE_FILE}"
    fi
  done
  set +e
  eval "$pyenv_init_script"
  pyenv
else
  eval "$pyenv_init_script"
fi

# Install Python and pyenv virtualenvs
show_info "Checking and installing Python dependencies..."
install_pybuild_deps

show_info "Checking and installing git lfs support..."
install_git_lfs

show_info "Installing Python..."
install_python

show_info "Checking Python features..."
check_python

set -e
show_info "Creating virtualenv on pyenv..."
pyenv virtualenv "${PYTHON_VERSION}" "venv-${ENV_ID}-manager"
pyenv virtualenv "${PYTHON_VERSION}" "venv-${ENV_ID}-agent"
pyenv virtualenv "${PYTHON_VERSION}" "venv-${ENV_ID}-common"
pyenv virtualenv "${PYTHON_VERSION}" "venv-${ENV_ID}-client"
pyenv virtualenv "${PYTHON_VERSION}" "venv-${ENV_ID}-storage-proxy"
pyenv virtualenv "${PYTHON_VERSION}" "venv-${ENV_ID}-console-server"

# Make directories
show_info "Creating the install directory..."
mkdir -p "${INSTALL_PATH}"
cd "${INSTALL_PATH}"

# Install postgresql, etcd packages via docker
show_info "Launching the docker-compose \"halfstack\"..."
git clone --branch "${SERVER_BRANCH}" https://github.com/lablup/backend.ai
cd backend.ai
cp docker-compose.halfstack.yml "docker-compose.halfstack.${ENV_ID}.yml"
sed_inplace "s/8100:5432/${POSTGRES_PORT}:5432/" "docker-compose.halfstack.${ENV_ID}.yml"
sed_inplace "s/8110:6379/${REDIS_PORT}:6379/" "docker-compose.halfstack.${ENV_ID}.yml"
sed_inplace "s/8120:2379/${ETCD_PORT}:2379/" "docker-compose.halfstack.${ENV_ID}.yml"
$docker_sudo docker-compose -f "docker-compose.halfstack.${ENV_ID}.yml" -p "${ENV_ID}" up -d
$docker_sudo docker ps | grep "${ENV_ID}"   # You should see three containers here.

# Clone source codes
show_info "Cloning backend.ai source codes..."
cd "${INSTALL_PATH}"
git clone --branch "${SERVER_BRANCH}" https://github.com/lablup/backend.ai-manager manager
git clone --branch "${SERVER_BRANCH}" https://github.com/lablup/backend.ai-agent agent
git clone --branch "${SERVER_BRANCH}" https://github.com/lablup/backend.ai-common common
git clone --branch "${SERVER_BRANCH}" https://github.com/lablup/backend.ai-storage-proxy storage-proxy
git clone --branch "${SERVER_BRANCH}" https://github.com/lablup/backend.ai-console-server console-server

if [ $ENABLE_CUDA -eq 1 ]; then
  git clone --branch "${CUDA_BRANCH}" https://github.com/lablup/backend.ai-accelerator-cuda accel-cuda
fi

check_snappy() {
  pip download python-snappy
  local pkgfile=$(ls | grep snappy)
  if [[ $pkgfile =~ .*\.tar.gz ]]; then
    # source build is required!
    install_system_pkg "libsnappy-dev" "snappy-devel" "snappy"
  fi
  rm -f $pkgfile
}

show_info "Install packages on virtual environments..."
cd "${INSTALL_PATH}/manager"
pyenv local "venv-${ENV_ID}-manager"
pip install -U -q pip setuptools
check_snappy
pip install -U -e ../common -r requirements/dev.txt

cd "${INSTALL_PATH}/agent"
pyenv local "venv-${ENV_ID}-agent"
pip install -U -q pip setuptools
pip install -U -e ../common -r requirements/dev.txt
if [[ "$OSTYPE" == "linux-gnu" ]]; then
  $sudo setcap cap_sys_ptrace,cap_sys_admin,cap_dac_override+eip $(readlinkf $(pyenv which python))
fi
if [ $ENABLE_CUDA -eq 1 ]; then
  cd "${INSTALL_PATH}/accel-cuda"
  pyenv local "venv-${ENV_ID}-agent"  # share the agent's venv
  pip install -U -e .
fi

cd "${INSTALL_PATH}/common"
pyenv local "venv-${ENV_ID}-common"
pip install -U -q pip setuptools
pip install -U -r requirements/dev.txt

cd "${INSTALL_PATH}/storage-proxy"
pyenv local "venv-${ENV_ID}-storage-proxy"
pip install -U -q pip setuptools
pip install -U -r requirements/dev.txt

cd "${INSTALL_PATH}/console-server"
pyenv local "venv-${ENV_ID}-console-server"
pip install -U -q pip setuptools
pip install -U -r requirements/dev.txt

# Copy default configurations
show_info "Copy default configuration files to manager / agent root..."
cd "${INSTALL_PATH}/manager"
pyenv local "venv-${ENV_ID}-manager"
cp config/halfstack.toml ./manager.toml
sed_inplace "s/port = 8120/port = ${ETCD_PORT}/" ./manager.toml
sed_inplace "s/port = 8100/port = ${POSTGRES_PORT}/" ./manager.toml
sed_inplace "s/port = 8081/port = ${MANAGER_PORT}/" ./manager.toml
cp config/halfstack.alembic.ini ./alembic.ini
sed_inplace "s/localhost:8100/localhost:${POSTGRES_PORT}/" ./alembic.ini
python -m ai.backend.manager.cli etcd put config/redis/addr "127.0.0.1:${REDIS_PORT}"
cp config/sample.volume.json ./volume.json
sed_inplace "s/\"secret\": \"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\"/\"secret\": \"0000000000000000000000000000000000000000000\"/" ./volume.json
sed_inplace "s/\"default_host\": .*$/\"default_host\": \"${LOCAL_STORAGE_PROXY}:${LOCAL_STORAGE_VOLUME}\",/" ./volume.json

cd "${INSTALL_PATH}/agent"
pyenv local "venv-${ENV_ID}-agent"
cp config/halfstack.toml ./agent.toml
sed_inplace "s/port = 8120/port = ${ETCD_PORT}/" ./agent.toml
sed_inplace "s/port = 6001/port = ${AGENT_RPC_PORT}/" ./agent.toml
sed_inplace "s/port = 6009/port = ${AGENT_WATCHER_PORT}/" ./agent.toml

cd "${INSTALL_PATH}/storage-proxy"
pyenv local "venv-${ENV_ID}-storage-proxy"
cp config/sample.toml ./storage-proxy.toml
# comment out all non-vfs volumes
sed_inplace "s/^\[volume\./# \[volume\./" ./storage-proxy.toml
sed_inplace "s/^backend =/# backend =/" ./storage-proxy.toml
sed_inplace "s/^path =/# path =/" ./storage-proxy.toml
sed_inplace "s/^purity/# purity/" ./storage-proxy.toml
# add local vfs volume
sed_inplace "s/^path = .*$/path = \"${INSTALL_PATH//\//\\/}\/${VFOLDER_REL_PATH//\//\\/}\"/" ./storage-proxy.toml # replace paths of all volumes to local paths
echo "\n[volume.volume1]\nbackend = \"vfs\"\npath = \"${INSTALL_PATH}/${VFOLDER_REL_PATH}\"" >> ./storage-proxy.toml 

cd "${INSTALL_PATH}/console-server"
pyenv local "venv-${ENV_ID}-console-server"
cp console-server.sample.conf ./console-server.conf
sed_inplace "s/^port = 8080$/port = ${CONSOLE_SERVER_PORT}/" ./console-server.conf
sed_inplace "s/https:\/\/api.backend.ai/http:\/\/127.0.0.1:${MANAGER_PORT}/" ./console-server.conf
sed_inplace "s/ssl-verify = true/ssl-verify = false/" ./console-server.conf
sed_inplace "s/redis.port = 6379/redis.port = ${REDIS_PORT}/" ./console-server.conf

# Docker registry setup
show_info "Configuring the Lablup's official Docker registry..."
cd "${INSTALL_PATH}/manager"
python -m ai.backend.manager.cli etcd put config/docker/registry/index.docker.io "https://registry-1.docker.io"
python -m ai.backend.manager.cli etcd put config/docker/registry/index.docker.io/username "lablup"
python -m ai.backend.manager.cli etcd rescan-images index.docker.io
python -m ai.backend.manager.cli etcd alias python python:3.6-ubuntu18.04

# DB schema
show_info "Setting up databases..."
cd "${INSTALL_PATH}/manager"
python -m ai.backend.manager.cli schema oneshot
python -m ai.backend.manager.cli fixture populate sample-configs/example-keypairs.json
python -m ai.backend.manager.cli fixture populate sample-configs/example-resource-presets.json


# Virtual folder setup
show_info "Setting up virtual folder..."
mkdir -p "${INSTALL_PATH}/${VFOLDER_REL_PATH}"
cd "${INSTALL_PATH}/manager"
python -m ai.backend.manager.cli etcd put volumes/_mount "${INSTALL_PATH}/vfolder"
python -m ai.backend.manager.cli etcd put volumes/_default_host "local"
python -m ai.backend.manager.cli etcd put-json volumes "./volume.json"
cd "${INSTALL_PATH}/agent"
mkdir -p scratches
psql postgres://postgres:develove@localhost:$POSTGRES_PORT/backend database -c "update domains set allowed_vfolder_hosts = '{${LOCAL_STORAGE_PROXY}:${LOCAL_STORAGE_VOLUME}}';"
psql postgres://postgres:develove@localhost:$POSTGRES_PORT/backend database -c "update groups set allowed_vfolder_hosts = '{${LOCAL_STORAGE_PROXY}:${LOCAL_STORAGE_VOLUME}}';"
psql postgres://postgres:develove@localhost:$POSTGRES_PORT/backend database -c "update keypair_resource_policies set allowed_vfolder_hosts = '{${LOCAL_STORAGE_PROXY}:${LOCAL_STORAGE_VOLUME}}';"
psql postgres://postgres:develove@localhost:$POSTGRES_PORT/backend database -c "update vfolders set host = '${LOCAL_STORAGE_PROXY}:${LOCAL_STORAGE_VOLUME}' where host='${LOCAL_STORAGE_VOLUME}';"

show_info "Installing Python client SDK/CLI source..."
cd "${INSTALL_PATH}"
# Install python client package
git clone --branch "${CLIENT_BRANCH}" https://github.com/lablup/backend.ai-client-py client-py
cd "${INSTALL_PATH}/client-py"
pyenv local "venv-${ENV_ID}-client"
pip install -U -q pip setuptools
pip install -U -r requirements/dev.txt

# Client backend endpoint configuration shell script
echo "export BACKEND_ENDPOINT=http://127.0.0.1:${MANAGER_PORT}/" >> my-backend-ai.sh
echo "export BACKEND_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" >> my-backend-ai.sh
echo "export BACKEND_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" >> my-backend-ai.sh
echo "export BACKEND_ENDPOINT_TYPE=api" >> my-backend-ai.sh

echo "export BACKEND_ENDPOINT=http://0.0.0.0:${CONSOLE_SERVER_PORT}" >> my-backend-ai-session.sh
echo "export BACKEND_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" >> my-backend-ai-session.sh
echo "export BACKEND_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" >> my-backend-ai-session.sh
echo "export BACKEND_ENDPOINT_TYPE=session" >> my-backend-ai-session.sh

show_info "Pre-pulling frequently used kernel images..."
echo "NOTE: Other images will be downloaded from the docker registry when requested.\n"
$docker_sudo docker pull lablup/python:2.7-ubuntu18.04
$docker_sudo docker pull lablup/python:3.6-ubuntu18.04 # 3.8로 업데이트 하는 이슈도 가능!!
if [ $DOWNLOAD_BIG_IMAGES -eq 1 ]; then
  $docker_sudo docker pull lablup/python-tensorflow:2.3-py36-cuda10.1
  $docker_sudo docker pull lablup/python-pytorch:1.6-py36-cuda10.1
  if [ $ENABLE_CUDA -eq 1 ]; then
      $docker_sudo docker pull lablup/python-tensorflow:2.3-py36-cuda10.1
      $docker_sudo docker pull lablup/python-pytorch:1.6-py36-cuda10.1
      $docker_sudo docker pull lablup/ngc-pytorch:20.07-py3
      $docker_sudo docker pull lablup/ngc-tensorflow:20.07-tf2-py3
  fi
fi

DELETE_OPTS=''
if [ ! "$INSTALL_PATH" = $(readlinkf "./backend.ai-dev") ]; then
  DELETE_OPTS+=" --install-path=${INSTALL_PATH}"
fi
DELETE_OPTS=$(trim "$DELETE_OPTS")

cd "${INSTALL_PATH}"
show_info "Installation finished."
show_note "Default API keypair configuration for test / develop (my-backend-ai.sh):"
echo "> ${WHITE}export BACKEND_ENDPOINT=http://127.0.0.1:${MANAGER_PORT}/${NC}"
echo "> ${WHITE}export BACKEND_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE${NC}"
echo "> ${WHITE}export BACKEND_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY${NC}"
echo "> ${WHITE}export BACKEND_ENDPOINT_TYPE=api${NC}"
echo " "
show_note "Default ID/Password configuration for test / develop (my-backend-ai-session.sh):"
echo "> ${WHITE}export BACKEND_ENDPOINT=http://0.0.0.0:${CONSOLE_SERVER_PORT}/${NC}"
echo "> ${WHITE}export BACKEND_ENDPOINT_TYPE=session${NC}"
echo "> ${WHITE}backend.ai login${NC}"
echo "> ${WHITE}ID      : admiu@lablup.com${NC}"
echo "> ${WHITE}Password: wJalrXUt${NC}"
echo " "
echo "These environment variables are added in my-backend-ai.sh and my-backend-ai-session.sh."
show_important_note "You should change your default admin API keypairs for production environment!"
show_note "How to run Backend.AI manager:"
echo "> ${WHITE}cd ${INSTALL_PATH}/manager${NC}"
echo "> ${WHITE}python -m ai.backend.gateway.server --debug${NC}"
show_note "How to run Backend.AI agent:"
echo "> ${WHITE}cd ${INSTALL_PATH}/agent${NC}"
echo "> ${WHITE}python -m ai.backend.agent.server --debug${NC}"
show_note "How to run Backend.AI storage-proxy:"
echo "> ${WHITE}cd ${INSTALL_PATH}/storage-proxy${NC}"
echo "> ${WHITE}python -m ai.backend.storage.server${NC}"
show_note "How to run Backend.AI console server (for ID/Password login):"
echo "> ${WHITE}cd ${INSTALL_PATH}/console-server${NC}"
echo "> ${WHITE}python -m ai.backend.console.server${NC}"
show_note "How to run your first code:"
echo "> ${WHITE}cd ${INSTALL_PATH}/client-py${NC}"
echo "> ${WHITE}backend.ai --help${NC}"
echo "> ${WHITE}backend.ai run python -c \"print('Hello World\\!')\"${NC}"
echo " "
echo "${GREEN}Development environment is now ready.${NC}"
show_note "Reminder: Your environment ID is ${YELLOW}${ENV_ID}${NC}."
echo "  * When using docker-compose, do:"
echo "    > ${WHITE}cd ${INSTALL_PATH}/backend.ai${NC}"
if [ ! -z "$docker_sudo" ]; then
  echo "    > ${WHITE}${docker_sudo} docker-compose -p ${ENV_ID} -f docker-compose.halfstack.${ENV_ID}.yml up -d ...${NC}"
else
  echo "    > ${WHITE}docker-compose -p ${ENV_ID} -f docker-compose.halfstack.${ENV_ID}.yml up -d ...${NC}"
fi
echo "  * To delete this development environment, run:"
echo "    > ${WHITE}$(dirname $0)/delete-dev.sh --env ${ENV_ID} ${DELETE_OPTS}${NC}"
echo " "

그렇다면, 이 install file을 실행시켜 보도록 하자. 몇번의 시행착오 끝에, delete-dev.sh파일을 믿고, 맥북에 설치하기로 결정하였다. 

sh파일을 실행시키는데 permission denied가 발생해서 'chmod +x'로 권한을 부여해 주었다.

> 혹시 본인이 사용하는 환경에 아래의 내용들이 미리 설치되어 있는지 꼭 확인하자!!!

※ 중간에 pyenv관련해서 'Can not proceed with installation' 에러가 발생한다면 brew로 pyenv를 설치하고 재시도 해보자.

※  brew install pyenv-virtualenv 역시 마찬가지이다. 설치해주고 이어가도록 하자. 

※  brew install psql 역시 마찬가지이다. 지금 표시된 ※ 들은 install-dev.sh를 실행시키기 전에 미리 설치해야 하는 내용들이다. 이놈들 때문에 항목들로 이 큰 프로젝트를 여러번 지우고 처음부터 설치하는 노가다를....크흡..ㅠㅠ

.......(오랜 기다림).......

......결국.......성공했다!!! ㅠㅠㅠㅠ WSL2에서 Mac까지 많이도 돌아왔다.....

 

실패한 시도.

< Windows10 + WSL2 + Ubuntu 조합 >

backend.ai-console -> install-dev.sh로 설치

wget으로 install-dev.sh파일 가져온다.

 wget https://raw.githubusercontent.com/lablup/backend.ai/master/scripts/install-dev.sh

./install-dev.sh

# -> env id changed!! [NOTE] Your environment ID is 1dcrdxsa.

※ docker-credential error 발생할경우

docker logout
mv ~/.docker/config.json ~/.docker/config_old.json
docker login

※ port already in use 발생할경우

$ docker container ls
You get something like:

CONTAINER ID        IMAGE               COMMAND             CREATED             STATUS              PORTS                  NAMES
12a32e8928ef        friendlyhello       "python app.py"     51 seconds ago      Up 50 seconds       0.0.0.0:4000->80/tcp   romantic_tesla   
Then you stop the container by:

$ docker stop 12a32e8928ef

stackoverflow.com/questions/46176584/docker-bind-for-0-0-0-04000-failed-port-is-already-allocated

 

Docker - Bind for 0.0.0.0:4000 failed: port is already allocated

I am using docker for the first time and I was trying to implement this - https://docs.docker.com/get-started/part2/#tag-the-image At one stage I was trying to connect with localhost by this comm...

stackoverflow.com

문제발생... 포스팅 보류,,,

( 계속된 에러문제 해결 과정과 아름답진 않은 삽질과정이 계속되었다... )

.

.

.

젠장,,,

< After my First openSource contribution > 

  이번 오픈소스 컨트리뷰톤은 Backend.AI 의 부분부분을 이해하다가 끝이 나버렸다. 사실, 많이 배웠지만 동시에 많이 아쉽다. 특히 오픈소스에 대한 이해를 끝내고 커미터로써 기여를 해봤어야 되는데 기회를 제대로 살리지 못한 듯 해서 부끄럽다. 학과수업과 졸업과제, 산학협력과제를 동시에 하느라 활동도 정성을 많이 들이지 못한 것 또한 사실이다. 하지만 첫술에 배부를 수는 없는 법이다. 실망하지 않고 힘 내서, 또 내 부족한 부분을 채워서 내년에 다시 도전해 봐야겠다.  (상장은 그냥..참가상..)

 

 

 

728x90
저작자표시

'[OpenSource | backend.ai]' 카테고리의 다른 글

[OpenSource | backend.ai] 3. backend.ai console 빌드 및 실행  (0) 2020.08.23
[OpenSource | backend.ai] 2. Git / 프로젝트 한글화 간단한 PR  (0) 2020.08.21
[OpenSource Contributhon] 1. Backend.ai, 발대식 참가(7/27)  (0) 2020.08.20

'[OpenSource | backend.ai]' Related Articles

티스토리툴바