共查询到20条相似文献，搜索用时 62 毫秒
1.
Hadoop作为云计算开源项目,已得到工业界和学术界的广泛认可。传统的Hadoop环境大多基于物理服务器,难以获取足够的实验场地和设备来建立Hadoop实验环境。同时,存在维护和管理代价高、资源浪费严重等问题。基于东华云平台,提出一种在单台物理服务器上运行多台虚拟机来创建虚拟化Hadoop环境的方法,即便只有一台服务器,也可以快速搭建Hadoop环境并进行基础实验,实验证明了该集群的可用性。 相似文献
2.
互联网的迅速发展产生了各种海量数据,快速有效处理海量数据是云计算的目标。Hadoop作为典型的云计算平台可高效处理海量数据。介绍了Hadoop相关概念,包括HDFS、MapReduce等众多子项目;阐述了Hadoop完全分布式平台搭建,包括环境配置、搭建方法等;通过数据处理实验验证了Hadoop分布式平台的有效性。 相似文献
3.
《实验室研究与探索》2016,(1):169-172
随着互联网和Web技术的飞速发展,现代社会的信息量迅速增长,中国已经步入"大数据"时代。Hadoop作为Apache基金会的开源项目,是一个分布式计算框架,主要处理大量数据,在业界和应用行业尤其是互联网行业得到了广泛应用。因此,研究它非常必要。本文对Hadoop的特点及其子项目进行深入探讨,以Hadoop1.1.0为基础,设计面向计算机基础教学的系列实验,从环境搭建、并行编程到数据迁移等七个方面,它涉及到Hadoop的多个子项目,形成一定的深度和广度。使学生能够更加深入了解和学习Hadoop,为今后的学习奠定扎实的基础,以便培养更好的Hadoop人才。 相似文献
4.
Hadoop平台是apche下的一个开源大数据平台,具有分布性、虚拟化、高可靠性、高可伸缩性、通用性等特点。Hadoop平台发展至今,集成组件已从1.0发展到2.0。从Hadoop体系结构入手,分析了Hadoop 平台1.0和2.0平台的基准测试性能并进行了对比。研究了testdfsIO、yarn、hive的基准测试,通过对升级后平台的基准测试,分析了2.0的优势,为集成Hadoop平台提供参考。 相似文献
5.
不断增大的数据规模给Hadoop集群处理能力带来了挑战,而合理的作业调度方式与策略能够提高集群的运行效率。通过对Hadoop MapReduce的任务调度机制进行研究,设计了节点负载能力与动态优先级的计算方式,提出了一种动态优先级的负载均衡调度算法,并搭建小型Hadoop平台进行了实验分析。结果表明,该算法在集群负载均衡方面的效果要优于传统调度算法。 相似文献
6.
7.
作为深受开发者青睐的主流大数据平台,Hadoop在数据的处理、分析及应用上拥有着其他平台不可比拟的优势。在介绍了大数据定义和Hadoop生态系统架构的基础上,分别对基于Hadoop提出的大数据存储、分析、管理、安全及应用等关键问题的解决方案进行了研究和综述。最后,对基于Hadoop的大数据平台的研究和应用发展方向进行了展望。 相似文献
8.
民航信息系统日志包含大量信息,但由于日志数据非结构化,不易被读取且数据量巨大,难以通过人工分析得出有价值信息。Hadoop分布式计算技术恰好可以很好地解决这个问题。设计了基于Hadoop的民航日志分析系统,系统结合数据挖掘领域经典的KNN分类算法,对算法进行了并行化改进,给出算法在Hadoop平台的MapReduce编程模型上的执行流程。对系统进行单机和集群测试,集群系统在处理较大规模数据时更高效。实验结果证明,系统具有较高的执行效率和可扩展性,对民航日志分析具有较高的实用价值。 相似文献
9.
目前大数据人才培养在国内外高校开始普及,但大数据实验室的几种常用建设方法都存在着诸多问题。针对大数据实验环境的特点,提出一种利用Docker容器技术在单台普通计算机上构建Hadoop集群的方法,并详述了Hadoop镜像制作、Docker环境部署、容器运行、Hadoop集群测试、Eclipse开发环境配置、镜像迁移等实验室建设细节。实践表明,新方法无需额外购置设备,节省实验室资金,同时未增加机房维护工作量,提高机房可复用性,新方法实验教学效果良好,为高校的大数据实验室建设提供参考。 相似文献
10.
11.
12.
13.
《海外英语》2007,(5):10-11
Many college freshmen arrive woefully unprepared to do college work, and as disadvantaged populations continue to grow, the share of the American work force that has made it through college is expected to plummet. Many experts blame that educational failure not just on high schools but also on colleges. School & College, a special report by The Chronicle, looks at efforts to fix the system. What reforms would better prepare students for college? What should schools and colleges be doing differently? How should state and federal officials help? 相似文献
14.
罗艳萍 《读与写:教育教学刊》2008,5(6)
The communication of people partially is the communication of cultures. Culture has a direct effect on international commercial activities in all aspects. Different conceptions about time, space, equality, law and the like, lead people to deal with things in different ways. So to know cultures of the counterpart is to facil-itate our enterprises so as to have a smooth and successful communication in commercial activity. 相似文献
15.
《海外英语》2007,(4):36
There are numbers of crossroads on our long and unpredictable life journey where we totally have no idea about which direction to choose. No matter what our decision is, we should not turn back, but face the music and go ahead instead. I am this kind of girl who always does try without regretting, one example is how I dealt with my love. 相似文献
16.
Migration occurs behind a variety of reasons and has a great effect on the whole world. People may migrate in order to improve their economic situation, or in order to escape civil strife, persecution, and environmental disasters. The impact of migration is complex, bringing both benefits anddisadvantages. This paper briefly talks about the causes of migration, the allocation of benefits, and the ways in which individual countries and the international community deal with this important subject. 相似文献
17.
Richard Denner 《海外英语》2007,(4):14-15
Rosco and I wait for the fishermen to return.I sit at a wooden bench near the store at Mt.Baker Resort and watch the clouds change shape. Rosco has my belt around his neck and an eight foot tow chain hooked to a tree. Dogs must be on a leash. Ducks and rabbits are loose. 相似文献
18.
Sister Carrie is one of the most controversial characters in American literature.Thought as a "fallen woman" firstly,she was defined as a "new woman" by some critics later. However, by digging into the motivaton behind the whole process of Carrie's "success", the relationship between Carrie and her creator (the author), the social conditions of then American, it can be found that Carrie has never been free-standing on her thought and she has never found her real-sdf even after becoming a famous actress. In a society dominated by mass consumerism Carrie is only an adherent of her own desires. She also is a representative of all those country girls flooded into cities, a symbol and a sacrifice of the urbanization of America in a time countryside was overcome by cities. 相似文献
19.
20.
RUZBEHANI Mohsen 《重庆大学学报(英文版)》2004,3(1):20-25
1.IntroductionOne-cyclecontrolmethod,whichwasproposedaboutonedecadeago[1],hasbecomeanattractivemethodinspecialfieldssuchaspowerfactorcorrection[2-6],switchingamplifiers[7,8],etc.Themainideaofthiscontrollerisbasedonintegrationofdiodevoltageinone-cycleandforcesittobeexactlyequaltothereferencevalue.Themainadvantageofthiscontrollerisitsrealtimeabilitytorejectthevariationofinputvoltage[1].Despitethisgreatability,ithasnogoodperformancesinrejectingofloaddisturbanceandfollowingreferencecommands.Espec… 相似文献