Building Talend Development Platform with Azure Gitlab from Azure Marketplace

Overview

This article shows how to provide Talend Development Platform with Azure Gitlab from Azure Marketplace.

 

This article explains how to use:

  • Azure Marketplace
  • Azure Virtual Machine

 

You will build an architecture with Azure Virtual Machine to create a virtual machine.

 

Architecture

Architecture.jpg

 

Prerequisites

 

Microsoft Azure

  • You have access to Microsoft Azure with a valid account (https://portal.azure.com)
  • You have full access to the Azure services described in the overview section above

 

Talend

You are familiar with the installation and the management of Talend Data Integration.

 

Environment

In this example, you use a Redhat 7.3 Linux environment to implement the architecture. Redhat 7.3 Linux is a standard image available on Microsoft Azure, but you can use another Linux system or Windows server system to implement it.

 

Creating a Gitlab virtual machine from Azure Marketplace

This section explains how to create an Azure Virtual Machine including Gitlab.

 

Procedure

  1. Go to the Azure Portal: https://portal.azure.com/.
  2. Click More services on the left tab.

    Creating Gitlab VM 1.jpg

     

  3. Click Marketplace.

    Creating Gitlab VM 2.jpg

     

  4. Enter gitlab in the filter box.

    Creating Gitlab VM 3.jpg

     

  5. Select Gitlab Community Edition.

    Creating Gitlab VM 4.jpg

     

  6. Click Create.

    Creating Gitlab VM 5.jpg

     

  7. Configure the basic settings as follows:

     

    Field

    Value

    Name

    Define the name of your virtual machine, for example aleducgitlab.

    VM disk type

    Define the type of disk: SSD or HDD.

    User name

    Define the user name you want to use to log in to the virtual machine.

    Authentification type

    Define the type of authentification: SSH public or Password.

    Resource group

    Select your resource group.

    If you do not have an existing resource group, create one. This allows you to manage your Azure environment easily.

    Location

    Select the location.

    Adapt the location to your area, for example West Europe.

     

    Creating Gitlab VM 6.jpg

     

  8. Select the size of your virtual machine, in this case, choose a small size.

     

    This section allows you to choose the number of CPUs and the size of the memory.

    The size depends on your environment.

    For more information, see https://docs.microsoft.com/en-us/azure/virtual-machines/windows/sizes.

     

    Creating Gitlab VM 7.jpg

     

  9. Configure the additional features as follows.

    Field

    Value

    High Availability

    Choose or create an Availability Set.

    By creating an availability set, Azure ensures that the virtual machines run across multiple Azure infrastructures (physical servers, storage units, and so on).

    Virtual network

    Keep the default value.

    The virtual network groups the virtual machines that you connect together.

    Public IP address

    Define the Public IP address. In this case, create a static IP.

    You need a static IP because Talend Administration Center connects to the Azure Gitlab virtual machine where you set the IP.

    Network security group

    Define the Network security group. All the virtual machines needed for your architecture use the network security group (NSG).

    The network security group contains all the security of your architecture (inbound security rules, outbound security rules). For more information, see https://docs.microsoft.com/en-us/azure/virtual-network/virtual-networks-nsg.

    Diagnostics storage account

    Select the Azure storage where diagnostics data will be stored.

     

    Creating Gitlab VM 8.jpg

     

    Creating Gitlab VM 9.jpg

     

    Creating Gitlab VM 10.jpg

     

  10. Click Create to create and deploy your Azure Gitlab virtual machine once Azure validates the configuration.

    Creating Gitlab VM 11.jpg

     

 

Results

Creating Gitlab VM 12.jpg

 

Updating the Gitlab version

 

This section explains how to update the Gitlab version.

 

Why do you need to update?

In Talend version 6.4.1, the Gitlab version supported by this version is Gitlab 9.1.

Updating Gitlab 1.jpg

 

The default version installed with the Azure Marketplace is Gitlab 8.5, so you have to update it to Gitlab 9.1.9 (the latest 9.1 version).

 

All Gitlab version are listed on the following link: https://packages.gitlab.com/gitlab/gitlab-ce

 

Procedure

  1. Execute the following command:

    curl -s https://packages.gitlab.com/install/repositories/gitlab/gitlab-ce/script.deb.sh | sudo bash

    Updating Gitlab 2.jpg

     

  2. Then execute this command:

    sudo apt-get install gitlab-ce=9.1.9-ce.0

    Updating Gitlab 3.jpg

     

 

Results

  1. Connect to your Gitlab:

    URL: http://[Azure Gitlab Virtual Machine Static IP]

    Updating Gitlab 4.jpg

     

  2. At the first connection, define the root password.

    Updating Gitlab 5.jpg

     

  3. Check the Gitlab version.

    Updating Gitlab 6.jpg

     

 

Using Azure Gitlab with Talend

Your Azure Gitlab is now ready to use. This Azure Gitlab is identical to the Gitlab that you could have installed yourself manually.

 

In the following example, you will set up a project with Talend 6.4.1 and your Azure Gitlab.

 

Procedure

  1. Create a new project on Azure Gitlab.

     

    When you create a project on Gitlab, that means it is a Repository in Talend terminology. Talend recommends that you create a new Gitlab project for each Talend project.

    Updating Gitlab 7.jpg

     

  2. Define the name of your Gitlab project, for example talend.

    Updating Gitlab 8.jpg

     

  3. Configure your Talend Adminstration Center (TAC).

    Using Gitlab 3.jpg

     

    Using Gitlab 4.jpg

     

    Using Gitlab 5.jpg

     

  4. Create a new project on your Talend Administration Center, for example AzureGitlab.

    Using Gitlab 6.jpg

     

 

Result

  1. In your Azure Gitlab, check that the Talend project was created.

    Using Gitlab 7.jpg

Version history
Revision #:
7 of 7
Last update:
‎09-29-2018 12:18 AM
Updated by:
 
Labels (2)