first c a meeting
DESCRIPTION
TRANSCRIPT
First RussianCA meeting
ЖирновМиша
ФилиппШубин
Gary Serda
Шубин Алексей
Белокрылов Александр
Александр Белокрылов
Паша Вотчитцев
Что такое JAVA(SUNW)
Software
Services Storage
Servers
Network.com
™
The Information Age Has Just Begun!
Data Center Application Edge Client
Нельзя организовать сообщество без вложений!
JXTA java.sun.com
Looking Glass
java.com
, .Процессоры Серверы и пр
• Niagara 2
> http://www.sun.com/processors/niagara/• Rock
> http://blogs.sun.com/jonathan/entry/rock_arrived
• Thumper
> http://www.sun.com/servers/x64/x4500/
LibrarySoftware
DataProtectionSoftware
DataMgmt.
Software
Tape Drives
SL 8500
T9x40 T10000
L1400 9990 9985
Virtual Storage Manager
Storage Area Network Switches
Encryption KeyManagement
4e/4/5
5Xx0 NAS VTL
Storage Portfolio
USE IMPROVE EVANGELIZE
USE IMPROVE EVANGELIZE
Solaris 10
X Window System
Hardware
GNOME
Solaris and GNU/Linux
GNU utilities
System libraries
Linux kernel
POSIX+ extensions
Mozilla Firefox, Mozilla Thunderbird, OpenOffice.org, ...
UNIX utilities
POSIX
Solaris kernel
USE IMPROVE EVANGELIZE
Solaris 10Что я могу делать под
Solaris?
USE IMPROVE EVANGELIZE
Solaris 10
Дистрибутивы Solaris● Поддерживаемый Sun
– Solaris 10
– Solaris Express Community Edition (каждые 2 недели)
– Solairs Express Developer Edition (каждые 3 месяца)
● Community– BeleniX (LiveCD x86)
– Nexenta (GNU/Opensolaris)
– Martux (Sparc LiveCD)
– Schillix
● NEW! Проект Indiana!
http://blogs.sun.com/SFilippp
USE IMPROVE EVANGELIZE
Solaris 10
Project Indiana● .. is what everyone is talking about in
OpenSolaris land.● Is the promising new OpenSolaris binary
distribution● Lead by Ian Murdock: The 'Ian' in Debian.● Great new features you always wanted in
Solaris.
USE IMPROVE EVANGELIZE
Solaris 10
Project Indiana (cont'd)● Network based apt-like binary package
management called the Universal Packaging system
● The cool new Distro-constructor!• Simply select packages from repository• Customize look and feel• and spread your own distribution!
● www.opensolaris.org/os/project/indiana/
USE IMPROVE EVANGELIZE
Solaris 10
? Что такое Зоны?Контейнеры
Zones
+Resource Management
=Containers
Изолированные экземпляры Solaris (> 8000), собственная/разделяемая файловая система, собственный root-вый доступ, собственные настройки сети....Группирует набор процессов в “пулы”, Управление ресурсами между процессами
Способ легковесной виртуализации ОС....
USE IMPROVE EVANGELIZE
Solaris 10
?Что позволяют делать Зоны● Создание для каждого студента
Unix собственной среды для различных ( root- экспериментов с возможностью вого
)доступа● “ ” Создание песочницы для
, программистов для сборки и установкиприложений
● Создание тестовых окружений для новыхприложений
● Разделение вычислительных ресурсов между различными пользователями
● Объединение нескольких серверов в один● !Эмуляция нескольких серверов на одном
USE IMPROVE EVANGELIZE
Solaris 10
Solaris ДемонстрацияZones/Containers
Pentium Mobile Centrino, Solaris 10 x86
Global Zone1 Processor Share192.168.1.128
Web Zone3 Proacessor Shares192.168.1.150
Software Zone2 Processor Shares192.168.1.151
/usr, /platform, /sbin, /lib (r/o)(r/o)
/etc, /var /etc, /var (r/w) /etc, /var (r/w)
/usr/local /usr/local (r/w)
/cdrom /cdrom
(resource management becomes much more fun on multi-processor machines)
Solaris - может все проектBrandz
• Возможность запускать приложения других – Solaris ОС без перекомпиляции ядро
.эмулирует системные вызовы
• Возможно установить полноценные ОС в зону
• :Доступные виртулизации
> Linux-зона
> Windows
> Mac OS X .... ожидаетсяhttp://www.opensolaris.org/os/community/brandz/
Linux- зона
Можно запускать не только бинарные Linux – программы,
но и установить Linux в зону.
Примеры - http://sunhelp.ru
Windows в Solaris =)
Интересные ссылки по виртуализации
• Brandz http://www.opensolaris.org/os/community/brandz/
• Crossbow виртуализация сетевых интерфейсов http://www.opensolaris.org/os/project/crossbow/
• Sun'овский вариант Xen и не только:> http://www.openxvm.org/
• Руководство по системному администрированию: контейнеры в Solaris – управление ресурсами и зонами http://docs.sun.com/app/docs/doc/820-2979?l=ru&q=%D0%97%D0%BE%D0%BD%D1%8B
• LDOMS – виртуализация by Niagara http://www.sun.com/servers/coolthreads/ldoms/index.xml
USE IMPROVE EVANGELIZE
Solaris 10
DTrace Features● Dynamic Instrumentation
– Zero probe effect when disabled● Unified Instrumentation
– Instrument both kernel and applications
– Can follow flow-control across boundaries● Kernel Instrumentation
– Can instrument in-kernel subsystems like virtual memory, synchronization, scheduler
● Data Integrity– Errors always reported
USE IMPROVE EVANGELIZE
Solaris 10
DTrace Features● Arbitrary Actions● Predicates
– Take action only when condition is met
● High-level Control Language– C-like language describes predicates &
actions
– All ANSI C operators (add, subtract, etc)
– Access to kernel variables and data types
● User-defined variables● Data aggregation
USE IMPROVE EVANGELIZE
Solaris 10
Sample D-Light screen-shot
Source: Sun Microsystems, Inc.
+35%In an
Afternoon
Online ParcelTrackingSystem
+80%In a Day
FuturesForecastingApplication
+267%In 2 Days
MessageHanding
Benchmark
USE IMPROVE EVANGELIZE
Solaris 10
More about D-Light at● Demo of D-Light at
http://sunfeedroom.sun.com/linking/index.jsp?skin=twoclip&fr_story=FEEDROOM192569
● D-Light tutorial at http://blogs.sun.com/solarisdev/entry/project_d_light_tutorial
USE IMPROVE EVANGELIZE
Solaris 10DTrace Results on Production
Systems
Source: Sun Microsystems, Inc.
+32%In a
Morning
FinancialDatabase
+35%In an
Afternoon
Online ParcelTrackingSystem
+80%In a Day
FuturesForecastingApplication
+267%In 2 Days
+300%In 5 Hours
MessageHanding
Benchmark
DataRouting
Application
Интересные ссылки по D-trace
• Chime - GUI проект для D-trace> http://www.opensolaris.org/os/project/dtrace-chime/
• Коллекция D-trace скриптов> http://www.dtracescripts.com/
USE IMPROVE EVANGELIZE
Solaris 10
Traditional Volumes● Abstraction: virtual disk● Partition/volume for each
FS● Grow/shrink by hand● Each FS has limited
bandwidth● Storage is fragmented,
stranded
ZFS Pooled Storage● Abstraction: malloc/free● No partitions to manage● Grow/shrink
automatically● All bandwidth always
available● Pool allows space to be
shared
Storage PoolVolume
FS
Volume
FS
Volume
FS ZFS ZFS ZFS
Volumes versus ZFS
USE IMPROVE EVANGELIZE
Solaris 10
● Create a storage pool named “home” # zpool create home mirror disk1 disk2
● Create filesystems “ann”, “bob”, “sue” # zfs create home/ann /export/home/ann
# zfs create home/bob /export/home/bob
# zfs create home/sue /export/home/sue
● Add more space to the “home” pool # zpool add home mirror disk3 disk4
ZFS Administration
USE IMPROVE EVANGELIZE
Solaris 10
● Turn on compression for Ann's data # zfs compression=on home/ann
● Limit Bob to a quota of 10G # zfs quota=10g home/bob
● Guarantee Sue a reservation of 20G # zfs reservation=20g home/sue
● Take a snapshot of Ann's filesystem # zfs create home/ann@tuesday
ZFS Administration – Cool Features
Интересные ссылки по ZFS
• Слайды> http://www.opensolaris.org/os/community/zfs/docs/
zfs_last.pdf
• Учебные материалы> http://www.opensolaris.org/os/project/dtrace-chime/
• Интересные видео> http://www.infoworld.com/archives/videoTemplate.jsp?Id=1152&type=Screencasts&tag=Storage> http://www.youtube.com/watch?v=1zw8V8g5eT0
Интересные ссылки по Solaris
• Отличная презентация про Open Solaris> http://www.slideshare.net/gnunify/open-solaris
• Все необходимое:> http://www.opensolaris.org
NetBeans 6.0
What Is NetBeans?
• A comprehensive, modular Java IDE> Out-of-box support for Java SE, Java EE, Java ME> Large set of 3rd party modules (plug-in's)> Intuitive drag-and-drop development> Debugger, Profiler, Refactoring, etc...
• Free and open-source based> Open source since June, 2000> Large community of users and developers
• A platform for building applications> Rich client Java applications> Rich framework of windows, menus, tool bars, actions
What's New In NetBeans 6.0?
• Code editor enhancements• Ruby, JRuby, & Ruby on Rails support (*)• Easier installation and upgrading• Swing GUI data binding (+)• Integrated profiling, profiling � points� (+)• Integrated visual web features (*)• Mobility graphical game builder (*)• SOA & UML enhancements• Netbeans platform enhancements
(*) Topic of an additional tech demo session(+) Will see later in this tech demo session
Matisse GUI Builder (Demo)Java Desktop Database App• Swing Application Framework
• Beans Binding
• Java Persistence API
• Matisse GUI Builder
http://www.netbeans.org/kb/60/ide-gui-db-prev.html
Mobile Visual Game Builder
Out of the Box Java EE 5 Support
• Web application development (+)• Java EE 5 Support (+)• Debugging, testing, profiling• Struts and JavaServer Faces (JSF)• JBoss 4, WebLogic 9, WebSphere• Web services development (client + service) (+)• AJAX app development (Blueprints)• EJB application development
(+) Will see demo later in this session
Developer Collaboration
• Develop applications collaboratively
• Code-aware instant messaging
• Share entire development environment
• Multi-party file editing
• Conduct code reviews
• Collaborative debugging
• share.java.net public collaboration server
Debugging & Profiling
• Visual debugging (breakpoints, watchpoints)• Remote debugging of a process• On-the-fly code fixing• Debug JSP, Servlets, monitor HTTP Traffic• View, suspend, resume threads• Monitor thread activity• CPU time & visual method call-graph data• Object-centric view: # allocated, live, age• JVM telemetry: heap usage, garbage collection
Debugging & Profiling (Demo)
http://www.netbeans.org/kb/55/profiler-tutorial.html
HPC
Tokyo Institute of TechnologyNow delivering 47.38 TFLOPS38.18 TFLOPS in 31 Days using CRS 6 Linked sub-clusters
8 Voltaire Infiniband switches42 Sun Fire x4500 Data Servers80+ Racks360 Clearspeed FP accelerators655 Sun Fire x4600 Servers10,480 Opteron cores21 TeraBytes RAM1 PetaByte storage
Sun N1 Grid Engine Sun N1 System Manager Lustre parallel file system
Asia's fastest supercomputer
Galaxy 4 Thumper
InfinibandTier 2 Switch
100+ 7
1
Galaxy 4 Thumper
InfinibandTier 2 Switch
100+ 7
1
Galaxy 4 Thumper
InfinibandTier 2 Switch
100+ 7
1
Galaxy 4 Thumper
InfinibandTier 2 Switch
100+ 7
1
Galaxy 4 Thumper
InfinibandTier 2 Switch
100+ 7
1
x4600 x4500
InfinibandTier 2 Switch
100+ 7
1
InfinibandTier 1 Switch
InfinibandTier 1 Switch
CP
UOpteron GHz 2.1Flops/clock/core 4Cores per chip 4
Co
mpu
te n
ode
Sockets 4Cores 16Gflops 134Mem BW (GBps) 24Mem size (GB) 32Off-node BW (GBps) 4Approx watts 600Nodes/Rack 48
Disk drives 48Raw storage size (TB) 24Storage BW (GBps) 1Nodes/Rack 9
Sys
tem
Compute Nodes 3,936Compute cores 62,976Tflops 529 RatiosBisection BW (TBps) 7.9 0.015 B / FMem BW (TBps) 94 0.18 B / FMem size (TiB) 123 0.23 B / FBulk Store nodes 72Storage size (TB) 1,728 3.3 B / FStorage BW (TBps) 0.07 0.00014 B / FTotal Racks 95Approx total Sq feet 2,037 260 Tflops / KsqftApprox total Mwatts 2.4 224 Tflops / MW
Sto
rage
No
de
4 x 4 2-GBDDR2 DIMMs
3,936 Compute nodes in 82 C48 racks
One 4x DDRIB port per blade
(4 GBps)
Four cablesper shelf
Opt
4 socketsx 4 coresx 4 flops
72 Bulk Storage nodes in 8 racksX4500 (4 RU)
2 sockets x2 cores
Ranger Configuration Details
48 x500 GBdrives
OptPCI-X PCI-XPCI-X PCI-X PCI-X
IB HCA
8 SATA
drives
8 SATA
drives
8 SATA
drives
8 SATA
drives
8 SATA
drives
8 SATA
drives
2 GigE
2 GigE
IB HCA
Opt
OptPegasus 4S
Blade12-
bladeShelf
PCIe PCIe
Opt
OptHT2
PCIe fromeach blade
11 otherbladesin shelf
Magnum switch2,160 ports
IB leafswitch
NEM
HCA
24-port switch
HCAHCAHCAHCAHCAHCAHCAHCAHCAHCAHCA
Magnum switch2,160 ports
USE IMPROVE EVANGELIZE
Solaris 10
Sun Studio - Integrated C/C++/Fortran Оптимизирующие
компиляторы
(dbx)Продвинутый отладчик
Memory Leak Detection/Analysis (RTC)
Аналазитор производительности
Поддержка многоядерных и многопроцессорных систем
Многопоточные библиотеки
Анализатор потоков
OpenMP 2.5 API, MPI Поддержка
IDE NetBeansоснованное на
dmake – параллельный ираспределенный
, Сообщество разработчиков, поддержка треннинги
Sun Studio 12 Официальный релиз с полной поддержкой
: Sparc Solaris, Intel ПлатформыSolaris, Intel Linux (SUSE, RedHat)
Sun Studio ExpressPreview следующего релиза
D-Light – , удобное легковесное средство профилирования
– Все беслатно для любогоиспользования
Sun Studio Software
USE IMPROVE EVANGELIZE
Solaris 10
Sun Studio – Cool Tools● Графический отладчик и анализотор производительности● Memory Leak and Access Detection● GCCfss (GCC for Sparc Systems)● Data Race Detection Tool (DRDT)● ATS – Automatic Tuning System● Binary Improvement Tool (BIT) and Link-Time Optimizer● Simple Performance Optimization Tool (SPOT)● Distribute Make (dmake)● Compiler Commentary● Automatic Parallelization & Vectorization● Native Connector Tool● X-Designer GUI Builder
USE IMPROVE EVANGELIZE
Solaris 10
Автоматическое распараллеливание #include <math.h> #include <stdio.h>
#define N 10000000
double a[N], b[N], c[N]; double sum = 0.0;
void main(void) {
int i = 0;
loop:
a[i] = sin(i); b[i] = cos(i); c[i] = a[i]*a[i] + b[i]*b[i]; sum += c[i];
i = i+1;
if ( i < N ) goto loop;
printf("sum = %f\n", sum);
}
OMP_NUM_THREADS=1 timex ./a.outsum = 10000000.000000
real 39.95user 33.14sys 1.24
OMP_NUM_THREADS=2 timex ./a.outsum = 10000000.000000
real 22.45user 33.59sys 1.10
OMP_NUM_THREADS=4 timex ./a.outsum = 10000000.000000
real 11.19user 33.40sys 1.21
Sun Studio 11 против GCC
Compression
FPGA Circuits
Combinatorial
Chess: Game
Word Processing
Compute visual
Group theory &
Database
Compression
Simulated annea
200
300
400
500
600
700
800
900
467
412
290
623
420
671
417
873
439
522
360 342
226
398
342300
266
466
322
414
SPECint CPU2000 PerformanceUltraSPARC III+ 1.0GHz
46% betterRange:22% -124%
Compression
FPGA Circ
GCC Combinatoria
Chess: Gam
Word Proc
Compute visu
PERL
Group theo
Database
Compression
Simulated
500
750
1000
1250
1500
1750
2000
2250
2500
1178 1185
1650
953
2322
1534
1242
2118
1194
1873
1539
13581245
1101
1413
627
2078
10031068
1493
1265
1739
1161 1214
SPECint CPU2000 PerformanceOpteron (2.4GHz)
10% betterRange:7% -52%
Physics/Chromo
Shallow Water
MultiGrid Solver
Parabolic/Elliptic
3-D Graphics
Image Recogniti
Seismic Wave
Image Processi
Computational Che
Number Theory
Finite Element
High Energy Phys
Meterology:pollutan
0500
10001500200025003000350040004500500055006000650070007500
883
1501
545 741 561
7506
1181 1321
317 228469 377 569
250 217 110 172 151 165 98 235 112 180 215 133 232
SPECfp CPU2000 PerformanceUltraSPARC III+ 1.0GHz
352% betterRange:26% - 4449%
Physics/Chro
Shallow Wat
MultiGrid Solv
Parabolic/Ellip
3-D Graphics
Image Reco
Seismic Wav
Image Proc
Computationa
Number Theo
Finite Elem
High Energy
Meterology:p
600
8501100
1350
16001850
21002350
26002850
31003350
3600
2161
3599
1488
1835
1380
2062
1309
2458
1140
1400 1466
749
1887
1329 1274
754
999
15411731
941
1146 1217 12361096
640
1344
SPECfp CPU2000 PerformanceOpteron (2.4GHz)
45% betterRange:6% -183%
Sun Studio11
GCC
Интервалы: расширение для наукоемких задач
• Учет дискретности представления аналоговых данных, погрешности аппаратного округления, подсчет суммарной погрешности результата
• Различные режими округления дают различные результаты
f90 intx.f90 -fround=nearest; a.out
1.0000595
f90 intx.f90 -fround=positive; a.out
1.0001191
f90 intx.f90 -fround=negative; a.out
1.0
• Интервалы дают возможность получить границы погрешности вычисления
f90 intx.f90 -xarch=sse2 -xia; a.out
[1.0,1.0001191]
N1 Grid Engine Overview• Dynamic
Resource Management> Job Scheduling> Resource
monitoring > Policy
administration> User
authentication and access control
> Accounting and reporting
User Interfaces
N1 Grid Engine
Graphical Command-line
<java/><java/>
Programmatic (DRMAA)
<c/><c/>
Programmatic (DRMAA)
Browser (accounting)
Supported Platforms
Master Host Compute Host
Solaris 7, 8, 9, 10 on SPARCSolaris 8, 9, 10 on x86Solaris 10 on x64
Solaris 7, 8, 9, 10 on SPARCSolaris 8, 9, 10 on x86Solaris 10 on x64
Linux kernel 2.4-2.6 onx86/x64 (any distribution)
Linux kernel 2.4-2.6 onx86/x64 (any distribution)
Windows 2000/XP Pro,2000/2003 Server
Mac OS X on PPC
AIX 4.3, 5.1, 5.3
HP-UX 11.x
Irix 6.5
More Information
• Main product page:> http://www.sun.com/gridware/
• Open source project site:> http://gridengine.sunsource.net/
• Community site:> http://gridengine.info/
• Open source Service Domain Manager site:> http://hedeby.sunsource.net/
Sun Labs
http://research.sun.com/
What is Sun SPOT?
• A Java platform for developing applications for wireless networks and small devices
• Applications such as:> Robotics> Art> Toys> Personal electronics> Commercial Applications> Telemetries
Sun SPOT Device
• Basic device has three layers> Battery> Processor Board with
Wireless Communication> Sensor Board (add-on
card)
• Processor Board alone acts as a base-station
• User programs the device entirely in Java using Netbeans.
Sun SPOT Hardware
• Processor Board> 180 Mhz 32-bit ARM920T core, 512K
RAM, 4M Flash> 2.4 Ghz 802.15.4 radio with integrated
antenna> USB interface
• Sensor board> 2G/6G 3-axis accelerometer> light and temperature sensors> 8 3-color LEDS, 2 momentary switches,
6 analog inputs, 5 GPIO pins and 4 high current output pins and a ADC.
Sun SPOT Resources• Project Sun SPOT http://www.sunspotworld.com/
> Sun SPOT documents and applications notes> Short Video demos> Classroom Curriculum> Discussion Forum
• David's Blog: http://blogs.sun.com/davidgs/> Latest news, other informal information on Sun SPOT
• The Squawk Projecthttp://research.sun.com/projects/squawk/> Sun Microsystems official Squawk research project page
Wonderlandhttp://research.sun.com/projects/mc/mpk20.htmlhttp://research.sun.com/projects/dashboard.php?id=85http://www.projectdarkstar.com/
Другие интересные проекты Sun Labs• Fortress
> http://research.sun.com/projects/plrg/Fortress/overview.html
• Proximity communications> http://www.bio-itworld.com/newsitems/2005/sept2005/09-13-05-news-sun
• Search in music > http://research.sun.com/projects/dashboard.php?id=153
• Security, Cryptography, and Policy> http://research.sun.com/projects/dashboard.php?id=35
И много других: http://research.sun.com/projects/
Полезные ресурсы
• blogs.sun.com• blogs.sun.com/jonathan• developers.sun.ru• developers.sun.com• sun.com• ru.sun.com• sunhelp.ru
О чем мы не упоминали и о чем стоит узнать• Blackbox• Glassfish• JavaFX
Мы• http://developers.sun.ru/
• http://ru.sun.com/research/teachingmaterials.html
• /CA Page
• http://developers.sun.com/
• http://developers.sun.com/academic
• http://www.sun.com/edu/programs/sai/
• java.net, OpenSolaris.org, and NetBeans.org
• http://www.educationcommons.org
Что делать кроме презентаций?
• Локализация NetBeans• http://www.educationcommons.org/projects/display/CA/Get+Involved