David Yin's Blog

Currently Viewing Posts Tagged how-to

Migrating GitLab to another Server from Ubuntu 16.04 to Ubuntu 18.04

November 8, 2019
0 Comments

Because my old Gitlab is running on a Ubuntu 16.04 server. The latest LTS version of Ubuntu is already 18.04 for more than one year. I was thinking about to directly upgrade the server from 16.04 to 18.04.  There are still some chances it may fail and the server may crash. I can not afford to lose the data.

So the final decision is to migrate the Gitlab from the old server Ubuntu 16.04 to a new server with  Ubuntu 18.04.

This is how to do it.

First, I install the new server on my Proxmox VE environment with Ubuntu 18.04. 3CPU Cores and 4GB memory and 64GB storage. Meanwhile, the old server still uses Ubuntu 16.04. And the Gitlab version that I use is 12.4.2

On the Old Server

  1.  Shutdown Gitlab service 
    sudo gitlab-ctl stop unicorn
    sudo gitlab-ctl stop sidekiq
  2. Backup Gitlab on the old server 
    sudo gitlab-rake gitlab:bakcup:create
  3. Create a folder named gitlab-old 
    mkdir ~/gitlab-old
  4. Copy the backup file to the folder ~/gitlab-old 
    sudo cp ~/backups/xxxxxxxx_gitlab_backup.tar ~/gitlab-old
  5. Copy the Gitlab configuration files 
    sudo cp /etc/gitlab/gitlab.rb ~/gitlab-old
    sudo cp /etc/gitlab/gitlab-secrets.json ~/gitlab-old
    sudo cp -R /etc/gitlab/ssl ~/gitlab-old

Then all the important files are under folder ~/gitlab-old

My configuration of Gitlab changed the backup folder to ~/backups. The default path is /var/opt/gitlab/backups/

You can change it on the “Backup Settings” section in the file gitlab.rb

 

To verify the version of your gitlab installation, enter the following command.

sudo gitlab-rake gitlab:env:info

On the New Server

The server is a clean installation of Ubuntu 18.04. The only service is SSH  and postfix.

Before doing the migration, I transfer the whole folder ~/gitlab-old from the old server to this new server.

  1.  Add Gitlab source 
    curl https://packages.gitlab.com/install/repositories/gitlab/gitlab-ce/script.deb.sh | sudo bash
  2.  Install Gitlab 12.4.2 CE 
    sudo apt update
    sudo apt install gitlab-ce=12.4.2
  3. Copy the configuration files to folder /etc/gitlab 
    sudo cp ~/gitlab-old/gitlab* /etc/gitlab
  4. Copy the ssl folder to folder /etc/gitlab 
    sudo cp -R ~/gitlab-old/ssl /etc/gitlab
  5. Run Gitlab service for the first time 
    sudo gitlab-ctl reconfigure
  6. Shutdown the Gitlab services 
    sudo gitlab-ctl stop unicorn
    sudo gitlab-ctl stop sidekiq
  7. Copy the backup file to ~/backups then change the permission 
    sudo cp ~/gitlab-old/*.tar ~/backups
    sudo chown git:root ~/backups/*.tar
  8. Restore the Gitlab backup file 
    sudo gitlab-rake gitlab:backup:restore BACKUP=XXXXXX
  9. Restart Gitlab and check 
    sudo gitlab-ctl start
    sudo gitlab-rake gitlab:check SANITIZE=true

There are some notes for the above nine steps.

The backup file name looks like 1573175514_2019_11_07_12.4.2_gitlab_backup.tar. So the code in the step 8, BACKUP=1573175514_2019_11_07_12.4.2

The version of Gitlab I am using 12.4.2. I install the 12.4.2 on step 2. When I do the restore in step 8, it displays the error, the version does not match. The backup is 12.4.2, but the installation is 12.4.1. I have to do the apt update and apt upgrade to upgrade the Gitlab from 12.4.1 to 12.4.2. I am not sure where the problem came from. Just a reminder, double-check the version installed on the new server.

At the first step of adding the repo source, I always get the network error on my server. I believed it is the problem of guest OS on Proxmox VE. So I actually add the repo source and public key of gitlab source manually.

My current Gitlab information on the new server Ubuntu 18.04

davidyin@gitlab:~$ sudo gitlab-rake gitlab:env:info

System information
System: Ubuntu 18.04
Current User: git
Using RVM: no
Ruby Version: 2.6.3p62
Gem Version: 2.7.9
Bundler Version:1.17.3
Rake Version: 12.3.3
Redis Version: 3.2.12
Git Version: 2.22.0
Sidekiq Version:5.2.7
Go Version: unknown

GitLab information
Version: 12.4.2
Revision: 393a5bdafa2
Directory: /opt/gitlab/embedded/service/gitlab-rails
DB Adapter: PostgreSQL
DB Version: 10.9
URL: https://gitlab.g2soft.net
HTTP Clone URL: https://gitlab.g2soft.net/some-group/some-project.git
SSH Clone URL: git@gitlab.g2soft.net:some-group/some-project.git
Using LDAP: no
Using Omniauth: yes
Omniauth Providers:

GitLab Shell
Version: 10.2.0
Repository storage paths:
- default: /var/opt/gitlab/git-data/repositories
GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell
Git: /opt/gitlab/embedded/bin/git

At the end, I should give the credit to Didiet A. Pambudiono. Most of the steps above is based on this post.

php script timeout on php7.2-fpm and Nginx Webserver

October 23, 2019
0 Comments

Here is the background.

  • It is a php script that is accessed through a browser.
  • Server: Ubuntu 18.04
  • Web server: Nginx 1.14
  • php: php7.2-fpm

 

The script always stoped on 60 seconds.

The Nginx error log is shown below:

2019/10/23 14:05:18 [error] 996#996: *950 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 135.0.172.188, server: fctu.win, request: “GET /go/do-something.php HTTP/2.0”, upstream: “fastcgi://unix:/var/run/php/php7.2-fpm.sock”, host: “mywebsite.com”

It is a timeout.  I knew it.

In the beginning, I am looking for the php timeout settings.

I tried to add max_execution_time to 360. It doesn’t help.

At last, I add a line into Nginx settings.

fastcgi_read_timeout 180;

Sample code below:

location ~ \.php$ {
    fastcgi_pass unix:/var/run/php7.2-fpm.sock;
    fastcgi_index index.php;
    fastcgi_param   SCRIPT_FILENAME $document_root$fastcgi_script_name;
    fastcgi_read_timeout 180;
    include fastcgi_params;
}

 

Hot to fix the problem on the new installation MariaDB

March 29, 2019
0 Comments

After the installation of MySQL server or MariaDB on Ubuntu, I would like to use phpMyAdmin or Adminer to access the MySQL server. But the first time the error comes like below.

Access denied for user ‘root’@’localhost’

mysqli_real_connect(): (HY000/1698): Access denied for user ‘root’@’localhost’

MySQL connect error on phpMyAdmin

 

MySQL connect error on Adminer

Here is the solution to make the root connect to a server without error.

Continue reading “Hot to fix the problem on the new installation MariaDB”

OneDrive could not launch on Windows 10

October 25, 2017
0 Comments

It said: This application failed to start because it could not find or load the Qt platform plugin “windows” in “”. Reinstalling the application may fix this problem.

My current Windows 10 is version 1703, OS build 15063.674.

I knew OneDrive is the builtin with Windows 10. It can not be uninstall like a normal program.

Continue reading “OneDrive could not launch on Windows 10”

Bashrc is not loading? (Fixed)

May 29, 2017
0 Comments

I have the .bashrc file, but it is not loading when I connect my VPS through SSH.

The content of .bashrc looks like below:

alias ls='ls --color=auto'
force_color_prompt=yes
PS1='\[\033[1;36m\]\u\[\033[1;31m\]@\[\033[1;32m\]\h:\[\033[1;35m\]\w\[\033[1;31m\]\$\[\033[0m\] '

It provides a colorful terminal look.

How to fix the problem of .bashrc not loading?

Continue reading “Bashrc is not loading? (Fixed)”

How to connect DBF file and read data by PHP script

April 11, 2017
0 Comments

Afte last post, my php-fpm support the dbase database file now.  Here is an example php script.

$db = dbase_open('../db/clients.dbf',0);

if ($db){
	$record_numbers = dbase_numrecords($db);
	
	for ($i = 1; $i <= $record_numbers; $i++) {
		  $row = dbase_get_record_with_names($db, $i);
		  if ( strpos(trim($row['CLIENTNAME']), $clientname)  !== FALSE and $row['deleted'] != 1) {
			  	$clientid =  $row['CLIENTID']);
				
				echo 'Customer ID Number: ',$clientid,';
                 }
     }
}

0) The dbase file has two columns, one is CLIENTID, the other one is CLIENTNAME.

1) Open the dbase file, clients.dbf,  by relative path.

2) If the dbf file exists, get the total number of records.

3) Go through all records. If field CLIENTNAME is same as the variable, $clientname,  print client id.

Install dbase extension on php7, Ubuntu 16.04

April 11, 2017
0 Comments

I followed the instruction mostly based on mote0230 github.

Please be noticed that updating (and probably inserting) with arrays that contain named indexes, is not working. For my project, it is OK. I just need to read the data from dbf files.

dbase-pecl-php7

# PHP 7
sudo add-apt-repository ppa:ondrej/php
sudo apt-get install php7.0-fpm php7.0-curl php7.0-mysql php7.0-dev

Compile

# dbase for PHP 7
git clone git://github.com/mote0230/dbase-pecl-php7.git ~/php7-dbase
cd php7-dbase/
phpize
./configure
make
sudo make install
cd ~
rm -rf ~/php7-dbase

Continue reading “Install dbase extension on php7, Ubuntu 16.04”

iTunes Installation error on Windows 10

September 19, 2016
0 Comments

When I re-install iTunes on my Windows 10, after reset my PC, I got the error as below: iTunes Installation error: “Microsoft VC80.CRT.TYPE=”win 32″.version=8.0.50727.6195″.publicKeyToken=’1fc8b3b9a1e18e3b”.processorArchitecture “x86″”.Please refer to help and support for more information. HRESULT:0X800700C1

It annoied my half an hour to solve the problem. At last, I got the answer.

My Windows 10 may need a particular library file which is not included. It is Microsoft Visual C++ 2005 Service Pack 1 Redistributable Package MFC security Update.

Download here Microsoft Visual C++ 2005 Service Pack 1 Redistributable Package MFC Security Update

I download and install the x64 file. Then re-try the installation of iTunes, it is OK now. No Error comes out.

 

[Fixed] OBi110 is not working with Google Voice

June 27, 2016
10 Comments

Just a few days ago, my OBi110 device does not work with my Google Voice. I can not dial out, and no incoming call, until today, I fixed it.

Sometimes it said some configuration error. I sign in my OBiTalk account at https://www.obitalk.com/obinet/

Normally, the device OBi110 can do the firmware update through the OBiTalk account dashboard. but it did not work this time.

When I sign in my account, then go to the device configuration page. I can setup Google Voice account by clicking the gear icon beside the account. But, now it is shown a warning or error without setup.

obi110-not-updateThe error displayed is Authentication error.

Now, let me show you haw to fix this error. the most important part is to upgrade the firmware of the device.

The latest firmware is 1-3-0-2886, the current one on my OBi110 is 1.3.0 – 2872

Continue reading “[Fixed] OBi110 is not working with Google Voice”

How to fix error Age of Empires 3 in Windows 10

June 19, 2016
4 Comments

It is an error when I tried to play my Age of Empires III game in Windows 10. I have the game which is installed on Steam platform. It is an old game, which is released  11 years ago, or 2005. I played it on Windows XP, Windows 2000, and Windows 7. Now I installed it on Windows 10. It gave me an error and closed.

I checked and fixed the error with two steps.

Step 1. The error of compatible mode.

I located the executive files and change the properties. age3y.exe

It is located on Steam library. Mine is D:\steam-games. So the files are in d:\steam-games\steamapps\common\age of empires 3\bin\

Right click on the file and choose properties, click Compatibility tab, make sure choose Windows XP (Service Pack 3) Compatibility mode and choose Run this program as an administrator.

aoe3-compatibility-mode Continue reading “How to fix error Age of Empires 3 in Windows 10”

  • Archives