[Java] Select the fastest mirror in a group of addresses

[Chavo]

I needed something to consistently find the closest mirror.  At first I was thinking pings, but realized that relying on ICMP traffic would be a bad gauge if some mirrors disable it.  Then I considered location lookups based on IP but that is too broad for many purposes and often inaccurate.  So behold this 'psuedo-ping' solution!

Run it with debug on if you want more verbose information.

Code: [Select]

/*
 * Find the fastest mirror! :)
 */
import java.io.IOException;
import java.net.ConnectException;
import java.net.InetAddress;
import java.net.InetSocketAddress;
import java.net.Socket;
import java.net.SocketException;
import java.net.SocketTimeoutException;
import java.net.UnknownHostException;

public class MirrorSelector {

private static boolean DEBUG = false;
private static int MAX_TIME = 1000; // timeout time in ms and default length if an error occurs

public static InetSocketAddress selectMirror(InetSocketAddress[] mirrors)
{
Socket s = new Socket();
long[] times = new long[mirrors.length];
long start;

for(int i=0;i<mirrors.length;i++)
{
try{
s = new Socket();
start = System.currentTimeMillis();
s.connect(mirrors[i], MAX_TIME);
times[i] = System.currentTimeMillis() - start;
s.close();
if(DEBUG)
System.out.println("Connecting to " + mirrors[i] + " took " + times[i] + "ms");
}
/* I considered condensing all the specific exceptions into a generic handler
* since they all respond basically the same way
*/
catch(SocketTimeoutException ste)
{
System.out.println("Address " + mirrors[i] + " timed out");
times[i] = MAX_TIME;
}
catch(ConnectException ce)
{
System.out.println("Connect Exception: " + ce.getMessage() + " for " + mirrors[i]);
if(DEBUG)
ce.printStackTrace();
times[i] = MAX_TIME;
}
catch(SocketException se)
{
System.out.println("Unable to connect to " + mirrors[i]
     +", there may be a problem with your network connection.");
if(DEBUG)
se.printStackTrace();
times[i] = MAX_TIME;
}
catch(IOException ioe)
{
System.out.println("Error connecting to " + mirrors[i]);
if(DEBUG)
ioe.printStackTrace();
times[i] = MAX_TIME;
}
}

int fast_id = 0;
long fast_time = MAX_TIME;
for(int i=0;i<times.length;i++)
{
if(times[i] < fast_time)
{
fast_id = i;
fast_time = times[i];
}
}

return mirrors[fast_id];
}

public static InetSocketAddress getClosestMirror(String hostname, int port)
{
InetAddress[] ips;

try{
ips = InetAddress.getAllByName(hostname);
}
catch(UnknownHostException uhe)
{
System.out.println("Unable to resolve host: " + port);
return null;
}

InetSocketAddress[] mirrors = new InetSocketAddress[ips.length];
for(int i=0;i<ips.length;i++)
{
mirrors[i] = new InetSocketAddress(ips[i], port);
}

return selectMirror(mirrors);
}


public static void main(String[] args)
{
System.out.println("Fastest: " + getClosestMirror("google.com", 80));
}
}

[Camel]

Neat little utility. Could be very useful. I'll probably steal it.

[Chavo]

Go for it, anything I make public is up for grabs.  Now that doesn't mean you can hack my svn server and claim it is public....

[Camel]

Of course, I always give credit where it's due. Since I use the GPL v2 for my project, I'd be publishing my modified version under that license. Is that okay with you?

Code: [Select]

/**
 * This file is distributed under the GPL
 * $Id$
 */

package net.bnubot.util;

import java.io.IOException;
...
import java.net.UnknownHostException;

/**
 * http://www.x86labs.org/forum/index.php/topic,10225.0.html
 * @author Chavo
 */
public class MirrorSelector {
...


[14:36:51] (MirrorSelector) Searching for fastest of 12 hosts for useast.battle.net
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.134 took 32ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.138 took 16ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.139 took 31ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.120 took 32ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.121 took 63ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.122 took 31ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.126 took 31ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.127 took 15ms
[14:36:51] (MirrorSelector) Connecting to useast.battle.net/63.240.202.128 took 16ms
[14:36:52] (MirrorSelector) Connecting to useast.battle.net/63.240.202.129 took 31ms
[14:36:52] (MirrorSelector) Connecting to useast.battle.net/63.240.202.130 took 31ms
[14:36:52] (MirrorSelector) Connecting to useast.battle.net/63.240.202.131 took 31ms
[14:36:52] Connecting to useast.battle.net/63.240.202.127:6112
[14:36:52] MPQ: ver-IX86-0.mpq
[14:36:52] (MirrorSelector) There was only one host: jbls.org/72.36.180.162
[14:36:52] Connected to jbls.org/72.36.180.162:9367

[Chavo]

sure, I figured someone might find this useful in a bot

[Camel]

http://bnubot.googlecode.com/svn/trunk/BNUBot/src/net/bnubot/util/MirrorSelector.java

Code: [Select]

/**
 * This file is distributed under the GPL
 * $Id$
 */

package net.bnubot.util;

import java.io.IOException;
import java.net.ConnectException;
import java.net.InetAddress;
import java.net.InetSocketAddress;
import java.net.Socket;
import java.net.SocketException;
import java.net.SocketTimeoutException;
import java.net.UnknownHostException;

/**
 * http://www.x86labs.org/forum/index.php/topic,10225.0.html
 *
 * @author Chavo
 */
public class MirrorSelector {
private static int MAX_TIME = 1000; // timeout time in ms

public static InetAddress selectMirror(InetAddress[] mirrors, int port) {
Socket s = new Socket();
long bestTime = MAX_TIME;
InetAddress bestHost = null;
long start;

for (InetAddress mirror : mirrors) {
long time;
try {
s = new Socket();
start = System.currentTimeMillis();
s.connect(new InetSocketAddress(mirror, port), MAX_TIME);
time = System.currentTimeMillis() - start;
s.close();
Out.debug(MirrorSelector.class, "Connecting to " + mirror.getHostAddress() + " took " + time + "ms");

if (time < bestTime) {
bestTime = time;
bestHost = mirror;
}
} catch (SocketTimeoutException ste) {
Out.error(MirrorSelector.class, "Address " + mirror + " timed out");
} catch (ConnectException ce) {
Out.error(MirrorSelector.class, "Connect Exception: " + ce.getMessage() + " for " + mirror);
Out.exception(ce);
} catch (SocketException se) {
Out.error(MirrorSelector.class, "Unable to connect to " + mirror + ", there may be a problem with your network connection.");
Out.exception(se);
} catch (IOException ioe) {
Out.error(MirrorSelector.class, "Error connecting to " + mirror);
Out.exception(ioe);
}
}

if(bestHost == null) {
bestHost = mirrors[(int)(Math.random() * mirrors.length)];
Out.info(MirrorSelector.class, "There was no clear winner; randomly choosing " + bestHost.getHostAddress());
}
return bestHost;
}

public static InetAddress getClosestMirror(String hostname, int port)
throws UnknownHostException {
InetAddress hosts[] = InetAddress.getAllByName(hostname);
if (hosts.length == 1) {
Out.debug(MirrorSelector.class, "There was only one host: " + hosts[0]);
return hosts[0];
}
Out.info(MirrorSelector.class, "Searching for fastest of " + hosts.length + " hosts for " + hostname);
return selectMirror(hosts, port);
}
}

[Chavo]

spiffy, make sure you give yourself credit too!

[Ender]

Chavo, did you recently change your name? Sadly, I don't know you

[Chavo]

Yea, I was unTactical.  I realized that this is the only place that I still used that name and there wasn't any need.

[iago]

Chavo, did you recently change your name? Sadly, I don't know you

Haha, I hate it when that happens. Normally when a name changes like that I'll go into a person's post history or mistyped-password log or something to find out who it actually is, then reset their name.

[Chavo]

I thought I had changed it a while back...

[iago]

Did I change it back? I don't really pay attention to whose usernames I fix.

[Newby]

lol. I just go by avatars. Haha.

Anyway, LoRd[nK]/Eric/whateverthefuckhecallshimself did this a while back in VB. I remember because he shared the code with me and it wouldn't work right on my old slow POS computer, but worked fine on my "brand new" one 4 years ago or so.

[Joe]

StarCraft did this, too! It sends SYN's out to all the servers it resolves, and then only SYNACK's the one that ACK's the fastest.

[iago]

StarCraft did this, too! It sends SYN's out to all the servers it resolves, and then only SYNACK's the one that ACK's the fastest.

You got SYNACK and ACK backwards there. Starcraft only ACKs the server that SYNACKs the fastest is what you wanted.

But in any case, Starcraft doesn't use that level of control, it simply uses a connect() systemcall. It is possible that something automated is happening on the system level, but it's not Starcraft itself that does that.