[BNET/RB] Where to start...

[Ryan Marcus]

I am trying to write a binary bot for battle.net.

I started to look at some converted VB sources, and I tried to copy selected bits of code over at a time. Did not take me long to discover I was going no where fast.

Basically, I just want some basic pointers about where to start in terms of writting a binary bot.. I do not want to use CSB (I can't anyway) or anything like it.

I have:
Basic TCP/IP experience (I can buffer the CHAT protocol)
Advance Understanding of arrays, variables, constants, OOP aspects, etc.

I don't:
Any experience with battle.net binary connections
Any idea what the best way to "hash" is
Any idea what protocol battle.net or how to parse it.



Thanks in advance guys!

[Newby]

Hmm. If it's in Java, JavaOp2 has some really nice hashing functions and such, and is probably a good base to learn off of.

If it's in VB, I'm no longer good at programming (sad huh? ) so I cannot help you much.

Also, check out http://bnetdocs.valhallalegends.com as it will answer most of your questions.

[Ryan Marcus]

You guys reply so fast its not even funny...

Thanks for the thoughts.

I am programming in REALbasic (RB).

I will definitely take a look at iago's hashing methods and see if I can port them (manually, of course.)

I think bnetdocs might be a tad bit over my head, at the moment. I have no idea what a "word" or "dword" is, I know what a byte is, but I have no idea how to implement any of them into a string.

Also, when they refer to "length" they mean bytes, not characters, right?

[MyndFyre]

The binary Battle.net protocol is well-documented at BnetDocs.  Battle.net's protocol is an Application-layer protocol on top of standard TCP/IP.

I assume "RB" means "RealBasic."  You should be more clear about that in the future.  

I highly recommend you do not look at other peoples' source code.  Especially VB source code.  Generally, VB programmers don't write good code and then make it public (I'm not saying this is true about people here... necessarily...), and you'll have problems especially if you just try to convert it.  Instead, focus on making a bot by breaking it into tasks that you need to handle:

1.) Be able to read from and write to a network stream.  This can be handled by a control or object of your own choosing, but ultimately, if you're using Windows, you'll have to incorporate the Winsock API; for non-Windows development, you'll want to use the platform-specific socket libraries (most likely the basic Berkeley sockets implementation).  It would be wise to encapsulate this into some kind of class -- I believe classes can be instantiated more than once, as well.  Plus, your classes can hide how the receive and send data from the parts of your program that use the class, so you could have something like this (if RB allows conditional compilation):

Code: [Select]

Public Sub Send(ByVal data As DataBuffer)
#If Windows
  ' do Windows-specific calls like send() here.
#ElseIf Linux
  ' do Linux-specific calls here.
#ElseIf MacOSX
  ' do Mac OS-X specific calls here.
#EndIf
End Sub
2.) Be able to manage threads, if RB supports them.  Windows controls only allow updating on the thread that created the controls, and so you'll need to ensure that, if you're using multiple threads, you're only updating the controls on the proper thread.
3.) Understand the events appropriate to Battle.net.  Events are not necessary for every Server->Client message, and some S->C messages define multiple events (SID_CHATEVENT is one such message).  

To get yourself up-and-running somewhat quikly, I would suggest using BNLS to get started.  Buy an extra CD key for $5 if it makes you feel better, and use an account that you don't care about the password for.  It's another protocol to learn, but the BNLS logon sequence is fairly straightforward if you can read through the protocol specification.

You may not like CSB, but if you're an OOP-aware programmer, you should appreciate its application.  It does a good job of encapsulating and shielding the end-user from the intracacies of Battle.net, which is what a good component is supposed to do.

Hope that helps.

[edit]
To address other concerns:
BnetDocs has descriptions about the types of data used in Battle.net.  WORDs are 16-bit unsigned integers, and DWORDs are 32-bit unsigned integers.  You should also understand what signed and unsigned, as well has hex and binary representations are.  Endian-ness too.

[Newby]

RealBasic eh? Good luck with that!

(As for posting quick, I just happened to visit the forums the same time you posted this!)

Not sure what a WORD or a DWORD is? Well, have no fear, BnetDocs has most of that information (including what length is (bytes)) here!

[MyndFyre]

Somehow I also forgot to mention that BNCSUtil is also available for local hashing (somewhat silly, since I made the .NET version of it).  The COM parts of MBNCSUtil (.NET BNCSUtil more or less) also work with Windows clients, if RB supports COM.

[Ryan Marcus]

The binary Battle.net protocol is well-documented at BnetDocs.  Battle.net's protocol is an Application-layer protocol on top of standard TCP/IP.

I assume "RB" means "RealBasic."  You should be more clear about that in the future.  

Got that. I did state what RB meant in my above post

I highly recommend you do not look at other peoples' source code.  Especially VB source code.  Generally, VB programmers don't write good code and then make it public (I'm not saying this is true about people here... necessarily...), and you'll have problems especially if you just try to convert it.

I noticed.. I stopped trying when I realized  I was "going no where fast".

Instead, focus on making a bot by breaking it into tasks that you need to handle:

1.) Be able to read from and write to a network stream.  This can be handled by a control or object of your own choosing, but ultimately, if you're using Windows, you'll have to incorporate the Winsock API; for non-Windows development, you'll want to use the platform-specific socket libraries (most likely the basic Berkeley sockets implementation).  It would be wise to encapsulate this into some kind of class -- I believe classes can be instantiated more than once, as well.  Plus, your classes can hide how the receive and send data from the parts of your program that use the class, so you could have something like this (if RB allows conditional compilation):

Code: [Select]

Public Sub Send(ByVal data As DataBuffer)
#If Windows
  ' do Windows-specific calls like send() here.
#ElseIf Linux
  ' do Linux-specific calls here.
#ElseIf MacOSX
  ' do Mac OS-X specific calls here.
#EndIf
End Sub


REALbasic's TCPSocket, is cross-platform, so I do not need to re-write it per OS.

2.) Be able to manage threads, if RB supports them.  Windows controls only allow updating on the thread that created the controls, and so you'll need to ensure that, if you're using multiple threads, you're only updating the controls on the proper thread.

I know how to use threads, but I see no need for one. I can use timers if I want to check something every X seconds, or constantly. But I only need to respond when I get data, I am connected, there is an error, etc., right?

3.) Understand the events appropriate to Battle.net.  Events are not necessary for every Server->Client message, and some S->C messages define multiple events (SID_CHATEVENT is one such message).  

Ya.. I have a good understanding about which packets to send, what data should be in them, etc. The problems I am having involve parsing incoming packets and sending outgoing packets.

To get yourself up-and-running somewhat quikly, I would suggest using BNLS to get started.  Buy an extra CD key for $5 if it makes you feel better, and use an account that you don't care about the password for.  It's another protocol to learn, but the BNLS logon sequence is fairly straightforward if you can read through the protocol specification.

Ewww.... BNLS! . I think I might, but I have other ways of running all the things BNLS can do locally, and I think BNLS steals keys...

You may not like CSB, but if you're an OOP-aware programmer, you should appreciate its application.  It does a good job of encapsulating and shielding the end-user from the intracacies of Battle.net, which is what a good component is supposed to do.

If you have a way to use CSB with REALbasic, let me know. Its a good way to figure things out. (Not really, but w/e )

Hope that helps.

[edit]
To address other concerns:
BnetDocs has descriptions about the types of data used in Battle.net.  WORDs are 16-bit unsigned integers, and DWORDs are 32-bit unsigned integers.  You should also understand what signed and unsigned, as well has hex and binary representations are.  Endian-ness too.

Yep, thanks.


Here is some code I wrote up fast for WORDs and DWORDS:

Function MakeWORD, data as string, returns string:

Code: [Select]

 Dim tmp  as String
  Dim a  as String
  Dim B  as String
  DIM varMakeWORD as String
  tmp = Right("0000" + hex(Data), 4)
  a = Mid(tmp, 1, 2)
  B = Mid(tmp, 3, 2)
  varMakeWORD=Chr( Val("&H" + B) )
  varMakeWORD=MakeWORD + Chr( Val("&H" + a) )
  Return varMakeWORD


Function MakeFWORD, data as integer, returns string:

Code: [Select]

 Dim tmp  as String
  Dim a  as String
  Dim B  as String
  Dim c  as String
  Dim D  as String
  DIM varMakeDWORD as String
  tmp = Right("00000000" + hex(Data), 8)
  a = Mid(tmp, 1, 2)
  B = Mid(tmp, 3, 2)
  c = Mid(tmp, 5, 2)
  D = Mid(tmp, 7, 2)
  varMakeDWORD=Chr(Val("&H" + D))
  varMakeDWORD=MakeDWORD + Chr(Val("&H" + c))
  varMakeDWORD=MakeDWORD + Chr(Val("&H" + B))
  varMakeDWORD=MakeDWORD + Chr(Val("&H" + a))
  Return varMakeDWORD

Correct me if I am wrong, please.


[edit]
I have used BNCSUtil, and was planning on it.

Oh ya, one more:

Function ApplyHeaders, MessageID as Integer:

Code: [Select]

  subpacket = chr(&HFF) + chr(MessageID) + MakeWord(LenB(subpacket) + 2)
  // Add 2 because a WORD is to bytes.

subpacket is the packet data.

Correct me if I am wrong!

[MyndFyre]

I know how to use threads, but I see no need for one. I can use timers if I want to check something every X seconds, or constantly. But I only need to respond when I get data, I am connected, there is an error, etc., right?

Polling is a suboptimal way of waiting for data.  If you can put one thread into a blocking recv() or Receive() call, and then do other stuff in your main thread, you're way ahead of the game.  Threads can communicate to each other via events or callbacks, which is much more efficient than polling, and pretty much the way a blocking recv() call is intended to work.

Ewww.... BNLS! . I think I might, but I have other ways of running all the things BNLS can do locally, and I think BNLS steals keys...

Nah, BNLS doesn't steal keys, but be aware that anyone else looking at your internet connection can steal your keys and passwords. 

If you have a way to use CSB with REALbasic, let me know. Its a good way to figure things out. (Not really, but w/e )

Nah, I'm not suggesting you use CSB, just don't bash it like most experienced programmers.  It is an eloquent solution and a good exercise in modular programming.  Most people's problem with CSB stems from the stream of morons who don't understand how to program who also think they can use it.

I'm not experienced enough in Basic to comment on your code.  However, allow me to make a suggestion about handling incoming data that will make your life a jillion times easier.

Take a look at this class.  It accepts a byte array during creation, and then acts as if that byte array was a stream.

Essentially, if you want to read a DWORD, it acts as if you have a pointer and you're casting it to a DWORD (that's the function of the .NET BitConverter class, which is used heavily in this code).  For example (this is C#), I have:

Code: [Select]

public int ReadDword()
{
int i = BitConverter.ToInt32(m_data, m_pos);
m_pos += 4;
return i;
}
I could have expressed this equivalently as:

Code: [Select]

public unsafe int ReadDword()
{
int i = 0;
fixed (byte *pArray = &m_data)
{
pArray += m_pos;
i = (int*)pArray++;
m_pos += 4;
}
return i;
}
However, due to performance costs, I stuck with the managed version. 

For example, though, I might do something like this:

Code: [Select]

private void ParseBNCS(DataReader reader, short length, BncsMessage id)
{
switch (id)
{
case BncsMessage.SID_AUTH_INFO:
int logonType = reader.ReadDword();
int serverToken = reader.ReadDword();
int udpValue = reader.ReadDword();
DateTime mpqTime = DateTime.FromFileTime( reader.ReadQword() );
string ix86filename = reader.ReadNTString();
string crValueString = reader.ReadNTString();
ProcSidAuthInfo(logonType, serverToken, udpValue, mpqTime, ix86filename, crValueString);
break;
case default:
// inform the system of an unsupported message ID.
break;
}
}
Hopefully you can read that well enough to see that it would significantly help you to do something like that.

[Ryan Marcus]

Sure can. This right:

Code: [Select]

  Dim tmp  as String
  Dim a  as String
  Dim B  as String
  Dim c  as String
  Dim D  as String
  DIM varGetDWORD as Long
  tmp = Hex(Data)
  a = Mid(tmp, 1, 2)
  B = Mid(tmp, 3, 2)
  c = Mid(tmp, 5, 2)
  D = Mid(tmp, 7, 2)
  tmp = D + c + B + a
  varGetDWORD=Val("&H" + tmp)
  Return varGetDWORD


[Joe]

Gimme a sec, I'll post my buffer and debuffer. They're written for VB, and RemoveNTString is messy, but they should work nicely with little effort.


http://www.javaop.com/~joe/VB6/clsBuffer.cls
Usage:

Dim Buffer as New clsBuffer
With Buffer
    .InsertByte 1
    .PushRaw
    'Call insert subs for 0x50 components
    .PushBNCS &H50
    .Flush frmMain.sckBnet 'Pass a socket to send it from
End With

http://www.javaop.com/~joe/VB6/clsDebuffer.cls
Usage:

Public Sub Parse(Data as String)
Dim Debuffer as New clsDebuffer
With Debuffer
    .Buffer = Data
    .RemoveVoid 1
    PacketID = .RemoveByte(1)
    .RemoveVoid 2 'This is the length WORD, if you need it
    Select Case PacketID
        'Yeah. That.
    End Select
End Sub

Function ApplyHeaders, MessageID as Integer

You want to pass MessageID as Byte (see my packetbuffer above) because if you pass an integer bigger than a byte, say, 257, you'll get a runtime error when you cast it to a byte using Chr().

I think bnetdocs might be a tad bit over my head, at the moment. I have no idea what a "word" or "dword" is

http://www.javaop.com/~joe/datatypes/
I knew I wrote that for a reason. =p

I highly recommend you do not look at other peoples' source code.  Especially VB source code.  Generally, VB programmers don't write good code and then make it public

Although I'm terrified to suggest LoRd[nK] over myself, his BBBB code is about as clean as VisualBasic can get. I'm not sure if its all finished and stuff, but it's rather good. -shutter-. Anyhow, c0Ld-chaos (the site where he was hosted) had its domain expire, but it might be back now. Newby, do you know where to get a copy?

[Ryan Marcus]

Gimme a sec, I'll post my buffer and debuffer. They're written for VB, and RemoveNTString is messy, but they should work nicely with little effort.

http://www.javaop.com/~joe/VB6/clsBuffer.cls
Usage:

Dim Buffer as New clsBuffer
With Buffer
    .InsertByte 1
    .PushRaw
    'Call insert subs for 0x50 components
    .PushBNCS &H50
    .Flush frmMain.sckBnet 'Pass a socket to send it from
End With

I already have a working buffer, thanks. I will post it sometime...

http://www.javaop.com/~joe/VB6/clsDebuffer.cls
Usage:

Public Sub Parse(Data as String)
Dim Debuffer as New clsDebuffer
With Debuffer
    .Buffer = Data
    .RemoveVoid 1
    PacketID = .RemoveByte(1)
    .RemoveVoid 2 'This is the length WORD, if you need it
    Select Case PacketID
        'Yeah. That.
    End Select
End Sub

Dude.... THANK YOU!

Function ApplyHeaders, MessageID as Integer

You want to pass MessageID as Byte (see my packetbuffer above) because if you pass an integer bigger than a byte, say, 257, you'll get a runtime error when you cast it to a byte using Chr().

REALbasic has no byte data type. I will only pass integers under 257, and besides, the highest I need to go is &H82.

I think bnetdocs might be a tad bit over my head, at the moment. I have no idea what a "word" or "dword" is

http://www.javaop.com/~joe/datatypes/
I knew I wrote that for a reason. =p

Thank you once more!

I highly recommend you do not look at other peoples' source code.  Especially VB source code.  Generally, VB programmers don't write good code and then make it public

Although I'm terrified to suggest LoRd[nK] over myself, his BBBB code is about as clean as VisualBasic can get. I'm not sure if its all finished and stuff, but it's rather good. -shutter-. Anyhow, c0Ld-chaos (the site where he was hosted) had its domain expire, but it might be back now. Newby, do you know where to get a copy?

I have way to many source codes already... I have ported VB bots successfully (they will run and connect on mac), I just want to write one myself .


EDIT: De-murdified the quote blocks. -Joe

[Joe]

I de-murdified your quote blocks. =p

You're welcome, many times over. Feel free to IM me (information to the left) if you have any questions.

[MyndFyre]

REALbasic has no byte data type. I will only pass integers under 257, and besides, the highest I need to go is &H82.

Byte values are only valid under 255.  A byte is 8 bits, which can represent 0 to 2⁸ - 1.  2⁸ - 1 = 255.

Joe, I hope you corrected your data types document.  The last time you talked about it, half the stuff in it was wrong.  And you're really just recreating the BnetDocs data types stuff anyway.

[Ryan Marcus]

REALbasic has no byte data type. I will only pass integers under 257, and besides, the highest I need to go is &H82.

Byte values are only valid under 255.  A byte is 8 bits, which can represent 0 to 2⁸ - 1.  2⁸ - 1 = 255.

Joe, I hope you corrected your data types document.  The last time you talked about it, half the stuff in it was wrong.  And you're really just recreating the BnetDocs data types stuff anyway.

Sorry, met to say 255... Thanks.

[Ryan Marcus]

Gimme a sec, I'll post my buffer and debuffer. They're written for VB, and RemoveNTString is messy, but they should work nicely with little effort.


http://www.javaop.com/~joe/VB6/clsBuffer.cls
Usage:

Dim Buffer as New clsBuffer
With Buffer
    .InsertByte 1
    .PushRaw
    'Call insert subs for 0x50 components
    .PushBNCS &H50
    .Flush frmMain.sckBnet 'Pass a socket to send it from
End With

http://www.javaop.com/~joe/VB6/clsDebuffer.cls
Usage:

Public Sub Parse(Data as String)
Dim Debuffer as New clsDebuffer
With Debuffer
    .Buffer = Data
    .RemoveVoid 1
    PacketID = .RemoveByte(1)
    .RemoveVoid 2 'This is the length WORD, if you need it
    Select Case PacketID
        'Yeah. That.
    End Select
End Sub

Function ApplyHeaders, MessageID as Integer

You want to pass MessageID as Byte (see my packetbuffer above) because if you pass an integer bigger than a byte, say, 257, you'll get a runtime error when you cast it to a byte using Chr().

I think bnetdocs might be a tad bit over my head, at the moment. I have no idea what a "word" or "dword" is

http://www.javaop.com/~joe/datatypes/
I knew I wrote that for a reason. =p

I highly recommend you do not look at other peoples' source code.  Especially VB source code.  Generally, VB programmers don't write good code and then make it public

Although I'm terrified to suggest LoRd[nK] over myself, his BBBB code is about as clean as VisualBasic can get. I'm not sure if its all finished and stuff, but it's rather good. -shutter-. Anyhow, c0Ld-chaos (the site where he was hosted) had its domain expire, but it might be back now. Newby, do you know where to get a copy?

Sorry for the double post... Modify is going really slow..

You forgot to include your GetWORD and GetDWORD methods.. Any chance I could get those?