import collections import socket import ssl import logging as log from datetime import datetime import config as conf import stats from util import Progress from hashtree import HashTree,hashBlock from networkers import NetworkReader,NetworkWriter class Connection: def __init__(self): sock=socket.socket(socket.AF_INET, socket.SOCK_STREAM) sslContext=ssl.create_default_context(cafile=conf.peers) sslContext.check_hostname=False sslContext.load_cert_chain(conf.certfile,conf.keyfile) self._socket=sslContext.wrap_socket(sock) self._socket.connect((conf.hosts[0], conf.port)) fr=self._socket.makefile(mode="rb") fw=self._socket.makefile(mode="wb") self.incoming=NetworkReader(fr) self.outcoming=NetworkWriter(fw) def __enter__(self): return self.incoming,self.outcoming def __exit__(self, exc_type, exc_val, exc_tb): self._socket.shutdown(socket.SHUT_RDWR) self._socket.close() class Client: def __init__(self,filename,treeFile=""): self._incoming=None self._outcoming=None self._filename=filename self._treeFile=treeFile print(datetime.now(), "initializing...") if treeFile: self._tree=HashTree.load(treeFile) else: self._tree=HashTree.fromFile(filename) self._newLeaves=dict() ## Asks server for node hashes to determine which are to be transferred. # # Uses a binary HashTree, where item at k is hash of items at 2k+1, 2k+2. # # Requests nodes in order of a batch DFS. Needs stack of size O(treeDepth*batchSize). Nodes in each tree level are accessed in order. def negotiate(self): localTree=self._tree blocksToTransfer=[] nodeStack=collections.deque([0]) # root # initialize session jsonData={"command":"init", "blockSize":localTree.BLOCK_SIZE, "blockCount":localTree.leafCount, "version":conf.version} self._outcoming.writeMsg(jsonData) jsonData,binData=self._incoming.readMsg() assert jsonData["command"]=="ack" # determine which blocks to send print(datetime.now(), "negotiating:") progress=Progress(localTree.leafCount) while len(nodeStack)>0: indices=[] for i in range(conf.batchSize): indices.append(nodeStack.pop()) if len(nodeStack)==0: break self._outcoming.writeMsg({"command":"req", "index":indices, "dataType":"hash"}) jsonData,binData=self._incoming.readMsg() assert jsonData["index"]==indices assert jsonData["dataType"]=="hash" stats.logExchangedNode(len(indices)) frontier=[] for (j,i) in enumerate(indices): (j1,j2)=[HashTree.HASH_LEN*ji for ji in (j,j+1)] if localTree.store[i]!=binData[j1:j2]: # ie. 0-6 nodes, 7-14 leaves. 2*6+2<15 if 2*i+2