欢迎来到麦多课文档分享! | 帮助中心 海量文档,免费浏览,给你所需,享你所想!
麦多课文档分享
全部分类
  • 标准规范>
  • 教学课件>
  • 考试资料>
  • 办公文档>
  • 学术论文>
  • 行业资料>
  • 易语言源码>
  • ImageVerifierCode 换一换
    首页 麦多课文档分享 > 资源分类 > PPT文档下载
    分享到微信 分享到微博 分享到QQ空间

    TACC Retrospective-Contributions, Non-Contributions, and .ppt

    • 资源ID:389598       资源大小:181KB        全文页数:31页
    • 资源格式: PPT        下载积分:2000积分
    快捷下载 游客一键下载
    账号登录下载
    微信登录下载
    二维码
    微信扫一扫登录
    下载资源需要2000积分(如需开发票,请勿充值!)
    邮箱/手机:
    温馨提示:
    如需开发票,请勿充值!快捷下载时,用户名和密码都是您填写的邮箱或者手机号,方便查询和重复下载(系统自动生成)。
    如需开发票,请勿充值!如填写123,账号就是123,密码也是123。
    支付方式: 支付宝扫码支付    微信扫码支付   
    验证码:   换一换

    加入VIP,交流精品资源
     
    账号:
    密码:
    验证码:   换一换
      忘记密码?
        
    友情提示
    2、PDF文件下载后,可能会被浏览器默认打开,此种情况可以点击浏览器菜单,保存网页到桌面,就可以正常下载了。
    3、本站不支持迅雷下载,请使用电脑自带的IE浏览器,或者360浏览器、谷歌浏览器下载即可。
    4、本站资源下载后的文档和图纸-无水印,预览文档经过压缩,下载后原文更清晰。
    5、试题试卷类文档,如果标题没有明确说明有答案则都视为没有答案,请知晓。

    TACC Retrospective-Contributions, Non-Contributions, and .ppt

    1、,TACC Retrospective: Contributions, Non-Contributions, and What We Really Learned,Armando Fox University of California,Berkeley foxcs.berkeley.edu,Vision: “The Content You Want”,What do above apps have in common? Adapt (collect, filter, transform) existing content according to client constraints res

    2、pecting network limitations according to per-user preferences But: Lack of unified framework for designing apps that exploit this observation,Contributions,TACC, a model for structuring services Transformation, Aggregation, Caching, Customization of Internet content Scalable TACC server Based on clu

    3、sters of commodity PCs Easy to author “industrial strength” services Scalable Network Service (SNS) platform maps app semantics onto cluster-based availability mechanisms Experience with real users 15,000 today at UCB,Whats TACC?,Transformation (“local”, “one-to-one”) TranSend, Anonymizer Aggregatio

    4、n (“nonlocal”, “many-to-one”) Search engines, crawlers, newswatchers Caching Both original and locally-generated content Customization Per user: for content generation Per device: data delivery, content “packaging”,TACC Example: TranSend,Transparent HTTP proxy On-the-fly, lossy compression of specif

    5、ic MIME types (GIF, JPG.) Cache both original & transformed User specifies aggressiveness and “refinement” UI Parameters to HTML & image transformers,$,Top Gun Wingman,PalmPilot web browser Intermediate-form page layout Image scaling & transcoding Controlled by layout engine Device-specific ADU mars

    6、halling Including client versioning Originals and device-specific pages cached,$,A,ADU,html,Application Partitioning,Client competence Styled text, images, widgets are fine Bitmaps unnecessary Client responsiveness Scrolling, etc. shouldnt require roundtrip to server Client independence Very late co

    7、nversion to client-specific format,TACC Conceptual Data Flow,FE,User request,To Internet,Front end accepts RPC-like user requests Users customization profile retrieved Original data fetched from cache or Internet Aggregation/transformation workers operate on data according to customization profile,T

    8、ACC Model Summary,Mostly stateless, composable workers Unifies previously ad hoc applications under one framework Encourages re-use through modularization Composition enables both new services and new clients TACC breakdown provides unified way to think about app structure,Services Should Be Easy To

    9、 Write,Rapid prototyping Insulate workers from “mundane” details Easy to incorporate existing/legacy code Few assumptions about code structure Must support variety of languages May be fragile Composition to leverage existing code,Building a TACC Server,Challenge: Scalable Network Service (SNS) requi

    10、rements Scalability to 100Ks of users with high availability Cost effective to deploy & administer But, services should remain easy to write Server provides some bug robustness Server provides availability Server handles load balancing and scaling Preserve modularity (& componentwise upgradability)

    11、when deploying,Layered Model of Internet Services,TACC Layer Programming model based on composable building blocks SNS Layer: “large virtual server” Implements SNS requirements Cluster computing for hardware F/T and incremental scaling,httpd, etc.,TACC,Scalable Network Svc,Exploit TACC model semanti

    12、cs for software F/T SNS layer is reusable and isolated from TACC Application “content” orthogonal to SNS mechanisms Key to making apps easy to write,Why Use a Cluster?,Incremental scalability, low cost components High availability through hardware redundancyGoals: Demonstrate that clusters and TACC

    13、fit well together Separate SNS from TACC,Cluster-Based TACC Server,Component replication for scaling and availability High-bandwidth, low-latency interconnect Incremental scaling: commodity PCs,Front Ends,Caches,User Profile Database,Workers,Load Balancing & Fault Tolerance,Administration Interface,

    14、“Starfish” Availability: LB Death,FE detects via broken pipe/timeout, restarts LB,C,$,FE,$,$,FE,FE,LB/FT,“Starfish” Availability: LB Death,FE detects via broken pipe/timeout, restarts LB,C,$,FE,$,$,FE,FE,LB/FT,New LB announces itself (multicast), contacted by workers, gradually rebuilds load tables,

    15、If partition heals, extra LBs commit suicide FEs operate using cached LB info during failure,“Starfish” Availability: LB Death,FE detects via broken pipe/timeout, restarts LB,C,$,FE,$,$,FE,FE,LB/FT,New LB announces itself (multicast), contacted by workers, gradually rebuilds load tables,If partition

    16、 heals, extra LBs commit suicide FEs operate using cached LB info during failure,Fault Recovery Latency,Task queue length,Behavior in the Large,TranSend: 160 image transformations/sec = 10 Ultra-1 servers Peak seen during UCB traces on 700-modem bank: 15/sec Amortized hardware cost $0.35/user/month

    17、(one $5K PC serving 15,000 subscribers) Wingman: factor of 6-8 worse Administration: one undergraduate part-time,Building a Big System,Restartable, atomic workers Read-only data from other origin server(s) Orthogonal separation of scalability/availability from application “content” Multiple lines of

    18、 defense App modules agree to obey semantics compatible with these mechanisms Common-case failure behavior compatible with users Internet experience Enables reuse of whole workers, however diverse,Availability & Scalability Summary,Pervasive strategy: timeout, retry, restart Transient failures usual

    19、ly invisible to user Process peers watch each other Mostly stateless workers, xact support possible Simplicity from exploiting soft state Piggyback status info on multicast beacons Use of stale LB info fine in practice “Starfish” availability works in practice,Service Authoring,Keyword hiliting: 1 d

    20、ay Wingman: 2-3 weeks Various apps from graduate seminar projects Safe worker upload Annotate the Web “Channel aggregators”,New Services By Composition,Compose existing services to create a new one2.5 hours to implement Composes with TranSend or Wingman,TranSend Metasearch,Internet,Experience With R

    21、eal Users,Transparent enhancements Minimal downtime Low administration cost Multicast-based administration GUI Virtually no dedicated resources at UCB “Overflow pool” of 100 UltraSPARC servers Users dont mind relying on middleware proxy,Why Now?,Internets critical mass Commercial push for many devic

    22、e types (transistor curves) Cluster computing economically viable A good time for infrastructural services,Related Work,Transformational proxy services: WBI, Strands Application partitioning: Wit, InfoPad, PARC Ubiquitous Computing Computing in the infrastructure: Active Networks Soft state for simp

    23、licity and robustness: Microsoft Tiger, multicast routing protocols,Summary of Contributions,TACC, a composition-based Internet services programming model captures rich variety of apps one view of customization No-hassle deployment on a cluster Automatic and robust partial-failure handling Availabil

    24、ity & scaling strategies work in practice New apps are easy to write, deploy, debug SNS behaviors are free Compose existing services to enable new clients,Non-Contributions (a/k/a Future Work),Accidental contributions: Legacy code glue Cheap test rig for next project (prototyping path discovery; a b

    25、are bones “cluster OS”) Non-contributions: Fair resource allocation over cluster Built-in security abstractions Rich state management abstractions,What We Really Learned,Design for failure It will fail anyway End-to-end argument applied to availability Orthogonality is even better than layering Narr

    26、ow interface vs. no interface A great way to manage system complexity The price of orthogonality Techniques: Refreshable soft state; watchdogs/timeouts; sandboxing,How About State Management?,Transactional apps? APIs are there, but you have to roll your own consistency Groupware apps with group stat

    27、e? One way: distributed, F/T group state like SRM! Keeps state management orthogonal to SNS layer,The Moral: Consistency, Availability, Partition-resilience: pick at most 2,Future Work,TACC as test rig for Ninja Taxonomy of app structure and platforms What is the “big picture” of different types of Internet services, and where does TACC fit in? Joint work with Dr. Murray Mazer at the Open Group Research Institute Apply lessons to reliable distributed systems Formalize programming model,Finish writing thesis,


    注意事项

    本文(TACC Retrospective-Contributions, Non-Contributions, and .ppt)为本站会员(rimleave225)主动上传,麦多课文档分享仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对上载内容本身不做任何修改或编辑。 若此文所含内容侵犯了您的版权或隐私,请立即通知麦多课文档分享(点击联系客服),我们立即给予删除!




    关于我们 - 网站声明 - 网站地图 - 资源地图 - 友情链接 - 网站客服 - 联系我们

    copyright@ 2008-2019 麦多课文库(www.mydoc123.com)网站版权所有
    备案/许可证编号:苏ICP备17064731号-1 

    收起
    展开