Kategorie: Hints

Leave a reply

Checksum – Check

If you want to compare to folder, which are not based on the same system you can create to text files with an command and the compare them.

Linux systems use md5sum:

find . -type f -exec md5sum {} ';' >source_md5.txt
find . -type f -exec md5sum {} ';' >target_md5.txt

Mac systems use md5:

find . -type f -exec md5 {} ';' >source_md5.txt
find . -type f -exec md5 {} ';' >target_md5.txt

Then you can compare this files using following command.

diff <(sort source_md5.txt) <(sort target_md5.txt)


Leave a reply

Synology – Network Speed Test

In the last weeks I searched for a ways to analyse the speed test of my Demo-Synology and to get clear answers how fast a client can maximum be with the 10Gbit connection.

The Hardware is following:
DS1821+ (CPU AMD Ryzen V1500B)
32 GB RAM
System: DSM 6.2.3-25426 Update 3
8x Seagate Exos X16
Synology Cache SSD 2x 400GB Read and Write
10Gbit RJ45 Card
RAID – SHR1

Test Client:
MacPro 2019
96 GB RAM
System: BigSur 11.2
3,3 GHz 12-Core Intel Xeon W

1. Test – Difference between MTU Sizes

9000-1500 MTU
If you mix the MTU size (Server 9000 and Client 1500) the network speed drops down to 7.53 GBytes / 6.47 Gbits/sec testet with iperf. And about 727 write and 700 read, tested with AJA System Test,

1500-1500 MTU
If you use the same default MTU size (Server 1500 and Client 1500) the network speed looks good 10.9 GBytes / 9.35 Gbits/sec testet with iperf. And about 810 write and 785 read, tested with AJA System Test,

9000-9000 MTU
If you use the same big MTU size (Server 9000 and Client 9000) the network speed looks good 11.5 GBytes / 9.90 Gbits/sec testet with iperf. And about 865 write and 1076 read, tested with AJA System Test,

Conclusion:
If you use the same MTU the Network overhead is less and you get more performance. The best performance is with the MTU 9000

2. Test – AmorphousDiskMark

Searching for a tool do make standardized test I found AmorphousDiskMark from Katsura Shareware. It is a great tool and you can download it form the App Store – Download. It automatically creates 4 different Szenarios (Forum):
SEQ1MQD8 – sequential read/write one big file multiple streams
SEQ1MQD1 – sequential read/write one big file single streams
RND4KQD64 – random read/write many small files multiple streams
RND4KQD1 – random read/write many small files single streams

AmorphousDiskMark MTU 9000-9000

3. Test – AJA System Test

An easy way to test your storage is to use the AJA System Test. You can choose an Target Disk and specify the Test File Size. I would recommend to click on the charts icon on the bottom of the window to open the graphics with the frame number vs MB/secs. Here you can easy see if you get dropped frames or if the peak speed is very high but the average speed is weak.

4. Test – iPerf (Network Storages)

You have to make sure that you network connection to the storage is good and gives you the maximum speed. The easiest way to do this is, using iperf. It is an client – server application and you have to download and start it. You can download it at iperf.fr

The „server“ site can be startet with „iperf3 -s“ and on the client site you use „iperf3 -c <ip-address>“

On you Synology you can easily use it in a docker image by using this command: (Install Docker Package, Enable SSH in the System Settings and then type following)

sudo docker run -it --rm -p 5201:5201 networkstatic/iperf3 -s

(Source for this help LINK)

Then you get following protocol that shows you the speed without the overhead of a protocol (SMB, NFS …) With the option „-r“ you can refer the test between server and client.

Connecting to host 172.16.100.20, port 5201
[ 4] local 172.16.100.10 port 50489 connected to 172.16.100.20 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.16 GBytes 9.93 Gbits/sec
[ 4] 1.00-2.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 2.00-3.00 sec 1.15 GBytes 9.89 Gbits/sec
[ 4] 3.00-4.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 4.00-5.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 5.00-6.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 6.00-7.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 7.00-8.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 8.00-9.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 9.00-10.00 sec 1.15 GBytes 9.90 Gbits/sec

[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 11.5 GBytes 9.90 Gbits/sec sender
[ 4] 0.00-10.00 sec 11.5 GBytes 9.90 Gbits/sec receiver


Good help for iperf is from JamesCoyle

Results in detail

Server MTU 9000 – Client 1500

Connecting to host 172.16.100.20, port 5201
[ 4] local 172.16.100.10 port 50485 connected to 172.16.100.20 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 467 MBytes 3.92 Gbits/sec
[ 4] 1.00-2.00 sec 723 MBytes 6.07 Gbits/sec
[ 4] 2.00-3.00 sec 882 MBytes 7.40 Gbits/sec
[ 4] 3.00-4.00 sec 718 MBytes 6.02 Gbits/sec
[ 4] 4.00-5.00 sec 911 MBytes 7.64 Gbits/sec
[ 4] 5.00-6.00 sec 883 MBytes 7.41 Gbits/sec
[ 4] 6.00-7.00 sec 868 MBytes 7.28 Gbits/sec
[ 4] 7.00-8.00 sec 817 MBytes 6.86 Gbits/sec
[ 4] 8.00-9.00 sec 932 MBytes 7.81 Gbits/sec
[ 4] 9.00-10.00 sec 512 MBytes 4.30 Gbits/sec


[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 7.53 GBytes 6.47 Gbits/sec sender
[ 4] 0.00-10.00 sec 7.53 GBytes 6.47 Gbits/sec receiver

AmorphousDiskMark Server MTU 9000 – Client 1500
AJA Server MTU 9000 – Client 1500


Server MTU 9000 – Client 9000

Connecting to host 172.16.100.20, port 5201
[ 4] local 172.16.100.10 port 50489 connected to 172.16.100.20 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.16 GBytes 9.93 Gbits/sec
[ 4] 1.00-2.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 2.00-3.00 sec 1.15 GBytes 9.89 Gbits/sec
[ 4] 3.00-4.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 4.00-5.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 5.00-6.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 6.00-7.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 7.00-8.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 8.00-9.00 sec 1.15 GBytes 9.90 Gbits/sec
[ 4] 9.00-10.00 sec 1.15 GBytes 9.90 Gbits/sec


[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 11.5 GBytes 9.90 Gbits/sec sender
[ 4] 0.00-10.00 sec 11.5 GBytes 9.90 Gbits/sec receiver

AmorphousDiskMark Server MTU 9000 – Client 9000
AJA Server MTU 9000 – Client 9000

Server MTU 1500 – Client 1500

Connecting to host 172.16.100.20, port 5201
[ 4] local 172.16.100.10 port 50495 connected to 172.16.100.20 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.06 GBytes 9.09 Gbits/sec
[ 4] 1.00-2.00 sec 1.10 GBytes 9.41 Gbits/sec
[ 4] 2.00-3.00 sec 1.09 GBytes 9.36 Gbits/sec
[ 4] 3.00-4.00 sec 1.09 GBytes 9.34 Gbits/sec
[ 4] 4.00-5.00 sec 1.10 GBytes 9.41 Gbits/sec
[ 4] 5.00-6.00 sec 1.09 GBytes 9.38 Gbits/sec
[ 4] 6.00-7.00 sec 1.09 GBytes 9.35 Gbits/sec
[ 4] 7.00-8.00 sec 1.09 GBytes 9.38 Gbits/sec
[ 4] 8.00-9.00 sec 1.10 GBytes 9.41 Gbits/sec
[ 4] 9.00-10.00 sec 1.09 GBytes 9.41 Gbits/sec


[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 10.9 GBytes 9.35 Gbits/sec sender
[ 4] 0.00-10.00 sec 10.9 GBytes 9.35 Gbits/sec receiver

AmorphousDiskMark Server MTU 1500 – Client 1500
AJA Server MTU 1500 – Client 1500

Special Thanks to Tools at Work, first point of contact for system integration in Vienna Austria.


Leave a reply

AXLE MAM – proxy workflow

You can import pregenerated proxy files into your AXLE media asset management system. This can speed up your workflow, when you do not generate the proxy files on the same machine where your MAM is installed.

First you have to set the „Existing Proxies“ path in the „Advanced“ settings. There you can set the „Location of Existing Proxies:“ to a folder which AXLE should observe.

You have to rename your pregenerated proxy files with the prefix „DC“
example: austria.mp4 -> DCaustria.mp4

Keep the same folder structure like your highres material. The you can move the proxy files itto the import folder. Important you have to create a parent folder with the same name like your catalogs name.

After this you can move the highres material to the AXLE catalog. Depending on the amount of data it should now start to sync the proxy files. Every successful imported file will get an „.done“ as prefix.

The technical specification of the proxy file are „mp4 file h.264 codec with aac audio codec downmixed stereo – The video is 1MB/s 480p“ according to AXLE Support

Where to buy AXLE in Austria: Tools at Work


Leave a reply

DayOwl – Network

This guide should help you to set up networks with higher ranges and should set the default „ip-ranges“ for devices, like I do. It is thought for home networks and small business networks. In the last 10 years the numbers of Network Access Devices (NAD) has increased a lot. Even if you have one machine it can have different network interfaces and will require ip-adresses on all of them. So it can easy happen that your subnet with a /24 range is getting quite small after a few months. Changing this later makes you a lot of work, because you have to change the subnetmask on every device. Devices with enabled DHCP Client Service will not make you the problem, but static IP Adresses like switches, printers… will not be able to communicate with network devices out of their subnet. For example if you forget to change the subnet on a printer, you can use it from all devices which are in the network range of the subnet. But if you sent a printer job from a machine outside this subnet this will not work because the tcp connection can not be answered from the printer.

My solution is to create bigger networks from scratch on. I never use /24 subnets (with about 255 usable addresses).
I also recommend to use A-Class Networks. Starting 10.X.X.X and then use something like the postal code or the door number to easier remember the range.

For example:
Vienna – 4th district (ZIP-1040) is then 10.104.X.X
Korneuburg – (ZIP-2100) is then 10.210.X.X

This will save you time with routing issues with you want to make site-to-site VPNs or even normal VPNs.

You can use this online tool to calculate your Host Address Range.
http://www.subnet-calculator.com

My home network uses following:
IP Address: 10.104.0.0
Subnet Mask: 255.255.240.0
Host Address Range: 10.104.0.1 – 10.104.15.254

The first 255 Addresses are reserved for administrativ devices:
IP Range: 10.104.0.0 – 10.104.1.0

Network Hardware (1-19)
10.104.0.1 – 10.104.0.19

in this range I use following rules:
Firewall (1-4)
10.104.0.1 – 10.104.0.4
Switches (5-15)
10.104.0.5 – 10.104.0.15
Internal Servers (20-40)
10.104.0.20 – 10.104.0.40
Printers (70-79)
10.104.0.70 – 10.104.0.79
Access Points (80-110)
10.104.0.80 – 10.104.0.110

I love when the DHCP Server is doing an IP-Mac binding and gives the fix IP-Addresses. But I would recommend to give the essential heart of you network manual fix IP-Addresses (switches and firewall).



Leave a reply

WireGuard VPN – Ubuntu Server

WireGuard is the most modern and easiest way to go if you want to create an VPN Server. The guys from PiVPN created a great installer for RaspberryPi’s. But I need some more Power 🙂 So here is the fast installation guide for this:

Update and Upgrade your Server

sudo apt update
sudo apt full-upgrade

Install all needed packages

sudo apt-get install --assume-yes iptables-persistent dnsutils iptables-persistent wireguard-tools qrencode  net-tools

Now you can use the pivpn.io script to install

curl -L https://install.pivpn.io | bash

After the successful install you can create the user by typing

sudo pivpn -a

now you can edit the user profile you have created right now

nano /home/pi/configs/vs_mbp.conf 

If you leave the last line „AllowedIPs = 0.0.0.0/0, ::0/0“ like it is. Every traffic will be routed in your WireGuard VPN. If you want to have only the packages for the destination network routed you have to change it to your ip address range. For example: AllowedIPs = 10.210.0.0/24

[Interface]
PrivateKey = kPcrDnyRhjhNh+g6x3iqSR6DrFj0jRiR2GbUNgc1qFDxx=
Address = 10.6.0.2/24
DNS = 10.210.0.1, 1.1.1.1

[Peer]
PublicKey = YoKGLSuXRxv2WcaSzyVCDkIRqCW+BxHuK5VYvZg/7w0=
PresharedKey = hPvRvm5DqEreE8EXydEczi9R7Ygn4qKcrVKAVxvgH+W8=
Endpoint = X.X.X.X:51820
AllowedIPs = 0.0.0.0/0, ::0/0

I tested this installer with an Synology Virtual Machine Manager and Proxmox installation

If you don’t install the needed packages then you get following errors:

:::
::: sudo will be used for the install.
::: Hostname length OK
::: Verifying free disk space...
:::
::: Checking apt-get for upgraded packages.... done!
:::
::: Your system is up to date! Continuing with PiVPN installation...
:::    Checking for git... already installed!
:::    Checking for tar... already installed!
:::    Checking for wget... already installed!
:::    Checking for curl... already installed!
:::    Checking for grep... already installed!
:::    Checking for dnsutils... not installed!
:::    Checking for whiptail... already installed!
:::    Checking for net-tools... not installed!
:::    Checking for bsdmainutils... already installed!
:::    Checking for iptables-persistent... not installed!
/usr/bin/debconf-apt-progress: can't open /tmp/tmp.0xfbAZFK8b: Permission denied at /usr/bin/debconf-apt-progress line 249, <STDIN> line 3.
:::    Failed to install dnsutils!
:::    Failed to install net-tools!
:::    Failed to install iptables-persistent!

Durch die weitere Nutzung der Seite stimmst du der Verwendung von Cookies zu. Weitere Informationen

Die Cookie-Einstellungen auf dieser Website sind auf "Cookies zulassen" eingestellt, um das beste Surferlebnis zu ermöglichen. Wenn du diese Website ohne Änderung der Cookie-Einstellungen verwendest oder auf "Akzeptieren" klickst, erklärst du sich damit einverstanden.

Schließen