The character of big data are large scale,depth,velocity,common hardware and open source.Aiming at the system’s inefficiency and scalability problem of traditional relational database in big data analysis,this paper presents an algorithm of parallel join in a MapReduce environment based on column-store by introducing MapReduce computing model.The design of large data-oriented distributed computing models is proposed.It designs the MapReduce column-store file,and achieves optimization by cooperative localization strategy.Secondly,and the partition aggregation and the heuristic optimization strategy to realize the implementation of parallel join algorithm are proposed.Experimental results show that the algorithm has the high performance and scalability in execution time and load capacity.
Aiming at the problem of handling network partitions and intermittently link connectivity in Delay Tolerant Network(DTN),this paper proposes a Location-based Controlled Epidemic(LC-Epidemic) routing protocol for DTN.LC-Epidemic assumes each node be aware of its position without relying on other prior global topology knowledge,which makes it be more practical and reliable than some existing routing schemes.Performances of different routing strategies are then evaluated by simulations,and the results indicate that LC-Epidemic achieves an approximately high delivery ratio compared with Epidemic protocol,while introducing only 50% overheads to the network when the nodes move in a comparatively slow way and the messages have a short Time to Live(TTL).When the TTL of each message is set to be short,LC-Epidemic outperforms Binary Spray & Wait and First Contact protocols in average latency as long as the buffer resources of nodes is not a bottleneck factor in limiting the routing performance.
In the cloud environment,since the physical boundary of security domain blurs,and multi-tenants across the Internet share the same hardware resource pool,traditional network access control method no longer can satisfy the need of virtual network.By researching cloud-oriented virtual network access control method.It uses virtual network traffic isolation technology,IP multicast management and virtual mapping method based on Virtual eXtensible Local Area Network(VXLAN) protocol.It provides tunnel access technology to achieve cross-data center virtual machine communication,and it can isolate virtual flows within each different security domain.Experimental results prove that the using of VXLAN Tunnel End Point(VTEP) combined with the virtual gateway can access the virtual network for effective control and isolation,along with the strong analytical protocol effectiveness and operating efficiency.