tag:blogger.com,1999:blog-4778960813645956682011-10-09T11:24:06.524ZAlessandra Fortinoreply@blogger.comBlogger501100tag:blogger.com,1999:blog-477896081364595668.post-6250039685464288632009-01-07T21:03:00.002Z2009-01-07T21:06:21.762Z

There is a new vulnerability in OpenSSL in all versions prior to 0.9.8j, discovered by Google's security team. You will be happy to learn that the Grid PKI is not affected by the vulnerability since it uses RSA signatures throughout - only DSA signatures and ECDSA (DSA but with Elliptic Curves) are affected. (Of course you should still upgrade!)

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-13856795024943928632009-01-05T10:52:00.002Z2009-01-05T11:12:53.855Z

In 2006 two different MD5-signed certificates were created. A new stronger attack, announced last Wednesday (yes 30 Dec), allows the attacker to change more parts of the certificate, also the subject name. To use this "for fun and profit" one gets an MD5 end entity certificate from a CA (ideally one in the browser's keystore), and hacks it to create an intermediate CA which can then issue

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-61233856144992209142008-12-18T11:00:00.002Z2008-12-18T11:04:25.178Z

Folks, you probably saw the announcement, the new distribution came out of IGTF Sunday.Overall the release is not urgent. I meant to send out an evaluation earlier but ran out of time.--jensAnnotated changes:* Added accredited classic Indian Grid CA (IGCA) (hash da75f6a8) (IN)Good for those folks over in Cambridge working on EUIndiaGrid. INFNno longer has to be the catch all.* Updated IUCC root

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-46158713004758279512008-12-10T13:51:00.005Z2008-12-10T14:23:02.128Z

(Not really operations but this is my least-inappropriate gridpp blog for this...)I was invited by Lambeth City Learning Centre (www.lambethclc.org.uk) to give a talk about "computing and science" to schoolchildren. They were 14 year olds, it's the first time I've given talks to children.My first main point was that increases in computing performance enables researchers in every single field of

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-41991770316418198542008-10-09T12:32:00.002Z2008-10-09T12:35:37.349Z

APEL data provides a view of CPU efficiencies (CPU time/Wall time) across UKI sites. The table here shows the results for September.

Jeremy Colesnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-44250298266186400852008-09-29T08:41:00.003Z2008-09-29T08:56:43.987Z

What's new? NCHC is back in (Taiwan), new keys not vulnerable to Debian incident. A number of metadata files were updated.There is a new group, the IGTF RAT, Risk Assessment Team, which covers the whole world, timezone-wise (or close enough). The idea is when a vulnerability is announced via the IGTF, the RAT assesses the risk and alerts the CAs concerned. The idea, of course, comes from the

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-55864743414491935882008-09-09T19:23:00.005Z2008-09-09T19:51:07.063Z

GridMap revealed a brief period of all green on 8th September for GridPP sites. This reflects the hard work many sysadmins have put into getting their sites ready for the LHC first beam on 10th September.

Jeremy Colesnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-10382510332101049402008-08-21T15:49:00.002Z2008-08-21T15:58:28.767Z

LHCb have recently made a change to their software install SAM tests - as noted at todays WLCG Daily meeting:Some LHCB specific SAM CE tests were systematically failing everywhere because of a bug in one of the modules for installing software. These tests have been temporary set "not critical" until a fix will be in place and fully tested. However for once Glasgow knew about these failures at 23:

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-56131347616158819972008-07-02T11:08:00.007Z2008-07-02T12:20:30.630Z

Earlier today Steve released results from his new network tests (see his blog entry). As a first step to looking at the data the plot above shows the scatter of from site b SE - to site a CE results. For this view rates are capped at about 100 Mb/s (which impacts the UCLH-UCLC 164.5; RH1-RH1 764.9 and RH2-RH2 243.1 Mb/s results). As Steve mentions it is too early to draw conclusions but there are

Jeremy Colesnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-70405337688464336892008-06-20T10:35:00.002Z2008-06-20T10:49:34.082Z

WLCG CCRC post-mortem workshop – summaryAgenda: http://indico.cern.ch/conferenceTimeTable.py?confId=23563First part of workshop was on storage. Generally observed that there was insufficient time for middleware testing.CASTOR: Saw SRM ‘lock-ups’ – CASTOR network related. The move to SL4 is becoming urgent. There needs to be more pre-release testing. They want to prioritise tape recalls. [UK: RAL

Jeremy Colesnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-36260158881366728292008-06-12T11:37:00.005Z2008-06-12T15:36:32.241Z

MonitoringTalk about how everything feeds to gridview, but conveniently skips the lack of detail you normally find in gridview. Mentioned ongoing effort for sites to get an integrated view of VO activity ath their site. Too many pages to look at.Once again 'nice' names for sites were discussed - we want the 'real' name that a site is known as. Network monitoring tools were discussed (well, lack

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-52924376650385873832008-06-12T10:17:00.004Z2008-06-12T10:43:16.482Z

More from the CCRC post mortem meetingMiddleware1) No change from normal release procedures. FTM didn't seem to be picked up as a requirement by Tier-1s (however RAL had their own already in place). Problem was that there wasn't a definirive software list, just the changes needed. CREAM is coming (slowly) and SL5 WN perhaps by Sept 08SL5 plans - ATLAS would like to get software ready for winter

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-29291926969388159542008-06-12T07:41:00.007Z2008-06-12T10:16:46.670Z

Some crib notes from the CCRC postmortem workshop - These should be read together with the Agenda. Where I've commented its parts that I consider particularly useful.Storage1) Castor / StormGPFS vs GridFTP block sizes - GPFS 1MB, SL3 GridFTP 64K, SL4 GridFTP 256KReduced gridftp timeouts from 3600s to 3000sCMS had problems with GPFS s/w area - latency issue [same as ECDF?] - partly due to switch

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-72202677107244120852008-05-07T16:32:00.002Z2008-05-07T16:35:55.188Z

As has been broadcast several times, RAL suffered a power glitch which has had a bad effect on some services. One of those still outstanding is the GOCDB. See https://cic.gridops.org/index.php?section=rc&page=broadcastretrieval&step=2&typeb=C&idbroadcast=32223 for details.Posted here to raise awareness as people may use the RSS feed..

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-66155480320501692282008-04-28T11:05:00.004Z2008-04-29T08:28:26.217Z

Last week connectivity to the RAL Tier-1 was affected for many hours due to a large number of firewall connections being left open. The ops SAM tests quickly showed how the Tier-1 can act as a Single Point of Failure with the current setup. The evidence is in this gridpp grid status snapshot in the 24hrs column. Note that Dublin and ScotGrid sites were unaffected as they now run their own RB/WMS

Jeremy Colesnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-40652957370449727452008-02-14T11:49:00.002Z2008-02-14T11:54:58.052Z

Nice to see the RAL Tier-1 site has a blog over at http://www.gridpp.rl.ac.uk/blog/. I've Duly added it to the GridPP Planet site and picked up this rather useful snippet about the Areca RAID Cards.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-28438137336794596502008-02-08T11:21:00.000Z2008-02-08T11:36:46.123Z

People's v-p-inits stopped working - from the CERN VOMS. Turns out the UK CA certs had been taken out, in the mistaken belief they had been revoked... Without consulting me, of course. Apart from a flurry of email, I called Remi this morning asking him to put them back and he said he'd do that today.It was the root cert that was "suspected compromised" (but not "compromised", which is why we're

Jens Jensennoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-82589613744058310852008-02-06T11:41:00.000Z2008-02-06T11:50:30.030Z

GridPP uses the evo software for most of its videoconference meetings. It normally works pretty well (espcially when compared to VRVS / Access Grid) and the audio on my mac laptop is suprisingly good without the need of a headset. However, todays java web start did an upgrade to 1.0.8 and broke the video client - it just refused to start.Problem is caused by an incorrect shell script test in ~/.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-47413683378152380172008-02-04T17:00:00.000Z2008-02-04T17:49:59.556Z

Thought I'd start blogging some CA stuff because a lot of things happen which you may not otherwise hear about (or indeed care about, but at least you have the option). CAs are kind of operational so I thought it fits OK here. It ain't storage, that I know (except see below).Starting in the big world, we now have Ukraine and Morocco on board. I was a reviewer for both. Much of my review work (

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-87653962727953067532007-12-22T15:19:00.000Z2007-12-22T15:26:14.661Z

Well, Since it was Friday Night, just before Xmas, I thought I'd do what ervery sad geek would do, and fire off a batch of grid jobs to last over the shutdown. However, the voms servers at CERN had other plans:Contacting lcg-voms.cern.ch:15004 [/DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch] "dteam" FailedError: dteam: User unknown to this VO.Trying next server for dteam.Creating temporary

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-82833397299704349152007-11-28T23:29:00.000Z2007-11-28T23:37:49.430Z

Been debugging apparently slow transfers using FTS (now a 2.0 application....) and discovered a slight change in the UK setup.Previously I just set the total no if files per channel, but I noticed that even with that set high, my dteam transfers were still only popping one file at a time off the list.Turns out that the VO shares now have hard coded limits in which are only visible with the -x

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-11152230451211714892007-11-07T10:54:00.000Z2007-11-07T11:01:46.411Z

Got a shiny new Dell Optiplex 740 (AMD 64 X2 goodness) that I wanted to run request-tracker in a VM on. Installed ubuntu gutsy fine, Installed Xen fine, just wouldn't correctly boot any domU's to completion. I even tried out KVM seeing as it's new hardware that has the 'svm' flags in /proc/cpuinfo. That failed miserably at the modprobe kvm_amd stage with kvm: disabled by bios. Most odd as there

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-14528272082187765122007-10-22T20:24:00.000Z2007-10-22T20:32:16.312Z

Not strictly gridpp, but posting this here may save an administrator some sanity...I've just spent the day battling against ubuntu on a lab cluster. The server had successfully upgraded from Feisty (7.04) to Gutsy (7.10) and cfengine refused to work. At all. It was only a minor upgrade in cfengine too - 2.1.20 to 2.1.22.cfagent -qv -d2 hung - even with debugging on cfservd nothing obvious.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-50042960047635138932007-10-09T19:37:00.000Z2007-10-09T19:43:17.139Z

At todays dteam meeting, there was a discussion about informing the PMB of any significant changes to the infrastructure. As the standard SOP is to use the EGEE Broadcast tool on the CIC portal, it'd be nice if there was say an RSS feed that we could parse and extract UKI significant info into say the planet feed. Anyone care to add comments?

Elwellnoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-37125928954381875652007-09-30T07:28:00.000Z2007-09-30T07:38:55.082Z

Prior to running any transfer tests, I normally check the Gridmon plots for that site, the relevant T2 and RAL T1. Using the (non-default) options of 'Metric data on same graph" and "New graph on new test dest" (and "new test src"), you generally get a good feel for the sites capacity, and any 'slow' links associated with it. Sadly recently the Tier1 seems to be performing dreadfully WRT the

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-15746496447789562382007-07-11T10:12:00.001Z2007-07-11T10:29:39.152Z

OK, new quarter and time to get down to some testing as I'm well overdue. First up - Lancaster. Apart from some user error at this end (typo in script) it went pretty smoothly and can cope with 25 files in flight happily:ganglia plot from Glasgow end:showing 10,15,20,25 file setting in transfer channelI've also started the Oxford tests, but it seems to be much less happy - When transferring from

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-14056796557295366562007-07-04T13:57:00.000Z2007-07-04T14:07:35.915Z

Thanks to Neasan O'Neill, the Planet GridPP page now has a shiny new stylesheet to match the main GridPP site.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-82999220264840575232007-06-06T11:01:00.000Z2007-06-06T11:05:48.630Z

I'd been trialling planet, the RSS aggregator for a few months now, and I'm fairly pleased with it. So much so that it's now official :-)http://planet.gridpp.ac.uk should now show you, in a single place all the various Tier-2, operations and storage blogs. If there are any others that people want adding, drop me a note.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-42484926849497573212007-06-01T20:51:00.000Z2007-06-01T21:11:02.290Z

OK, I'll admit I occasionally rant about some things I consider "bad", but I'm afraid deleting files from grid storage is just Painful. to delete 490 (I nuked the first ten within the inner $i loop as a test of xargs) files I ended up with this nasty nasty hack:for j in `seq -w 2 49 ` ; do for i in 0 1 2 3 4 5 6 7 8 9 ; do echo -n "srm://$DPM_HOST:8443/dpm/gla.scotgrid.ac.uk/home/dteam/rt2-gla-5-

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-73074500931924241072007-05-30T20:12:00.000Z2007-05-30T20:19:58.142Z

In preparation for some serious testing of Bristol's StoRM implementation, Jon and I worked together to run some iperf tests so we know what our target is for FTS tests. Plot below - looks like we've got a 500Mb/s maximum.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-5219290630808374532007-05-16T23:13:00.000Z2007-05-16T23:18:31.982Z

Someone could hack something like flickrvision into the realtime monitor. hmmmm.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-35793489277309474202007-05-14T22:14:00.000Z2007-05-14T22:21:11.493Z

As I still haven't completed this quarters round of transfer tests I decided to set up all the scripts and prereqs for doing each T2. Ran my little perl script to get the current (pre-tuned) values for the transfer channels and noticed that they were all set to 5. Nope, my script hadn't broken (more than originally designed anyway) - it looks like someone changed 'em. Why?Site From RAL

Elwellnoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-67994659022710317172007-04-30T15:11:00.000Z2007-04-30T15:44:21.006Z

Apart from the Spring HEPiX 2007 meeting last week (which was excellent BTW - I'll do a proper writeup soon) I have been pushing on with Transfer tests. Rather than risk stressing the RAL CASTOR service too much while we work on improving the individual T2 sites, Chris Brew (RAL T2) was v helpful and we've been using their dCache pool (lots of beefy disk servers and some spare capacity) to push

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-85437316393603820932007-03-28T09:59:00.000Z2007-03-28T11:12:42.875Z

As you may have seen, there is a new IGTF release. In case they are still hiding the changelog from you, here is my annotated version:* Added BG.ACAD CA accredited under the classic profile (BG)This is Bulgaria. They are new - welcome on board.* Added SWITCHaai SLCS and (classic) Root CA (CH) NOTE: the SWITCHaai SLCS CA is included in the ca_policy_igtf-slcs bundleAh. This one is a biggie.

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-46705721872619302402007-03-23T11:01:00.000Z2007-03-23T11:08:10.609Z

This week (apart from the GridPP 18 meeting) I have been trying to complete the transfer tests, but am getting terrible rates out of RAL. The CERN Network Stats To RAL Don't look too excessive:But the iperf stats out of RAL have plummeted - The RAL-Lanc (who even have a private lightpath) one below is typical.

Elwellnoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-33160575723668391962007-03-13T10:35:00.000Z2007-03-13T10:43:43.037Z

Dear root@Birmingham,I broke your systemWell, I blame the filetransfer script - It uses your (long lifetime) myproxy for the transfers and the shorter voms-proxy for the delete. Result: one filled up disk when my voms proxy expired. Seems to have recovered OK.

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-88966681653313253502007-03-09T07:31:00.000Z2007-03-09T07:45:37.163Z

With a hat-tip to xkcd I decided to knock up an ugly script to convert this:aelwell@ppepc62:~$ ls tra*06T*.logtransfer-2007-03-06T09-52-38.log transfer-2007-03-06T14-38-59.log transfer-2007-03-06T19-06-22.logconsisting of blocks like Transfer: srm://ralsrma.rl.ac.uk:8443//castor/ads.rl.ac.uk/prod/grid/hep/disk1tape1/dteam/j/jkf/castorTest/1GBcanned000 to srm://svr018.gla.scotgrid.ac.uk:8443/dpm

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-11722353988873436902007-03-08T10:41:00.000Z2007-03-08T10:45:39.507Z

Another day, another pile of transfer tests. Or not. Problem renewing my voms-proxy.voms.cern.ch bombed out with:Error: Could not establish authenticated connection with the server.GSS Major Status: Unexpected Gatekeeper or Service NameGSS Minor Status Error Chain: an unknown error occurredso I raised GGUS Ticket (19457)

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-1027748544460030512007-03-08T09:11:00.000Z2007-03-08T09:14:15.219Z

There is a new link on my ATLAS tests page "All Logs" which allows one to look at old log and output files. These can be filtered by institute. It's a bit flaky because the webserver isn't really up to it. Logs before February 8 have been lost.

Steve Lloydnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-18018273200152260302007-03-05T13:33:00.000Z2007-03-05T13:36:52.481Z

Started to work on the Q1 transfer tests (hey, I know I only have a month to go) - Stub on the Wiki at http://www.gridpp.ac.uk/wiki/2007-Q1_Transfer_TestsNext step this afternoon is to try and get the experiment dress rehersal timetable and ensure we're not clashing

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-10818608486969613822007-03-01T10:16:00.000Z2007-03-01T15:33:31.004Z

Following Jeremy's posting to the gridpp-dteam gently reminding us all that the wiki was in need of a tidy, I decided to take a look at some stats:There are currently 92 Uncategorized pages and there are 52 Categories. I guess I'll start by categorising the uncategorised pages, then creating stubs for those that are presently the most requested (ie, we've created a hanging link) - see List of

Elwellnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-69924284375904056592007-02-23T10:13:00.000Z2007-02-23T10:16:02.312Z

Here is a summary of a set of grid jobs that I ran yesterday to test posix access to site SEs. The job will eventually become the SAM test for this type of storage access. In summary it lcg-cr's a small test file to the SE, then reads it back again using a GFAL client, checks for consistency and then deletes the file using lcg-del.srm.epcc.ed.ac.uk Passedsvr018.

Greig A Cowannoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-63412246444298576052007-02-19T14:48:00.000Z2007-02-19T15:23:28.129Z

Replicas: Finally managed to make a replica at Durham (strange bug discovered). Only Sheffield now outstanding (not the same bug). My analysis jobs now run at Durham (most of the time).There was a screw up on Friday when my proxy expired and this stopped everything till I sorted it out in the evening. I think I've deleted all the jobs from the record so they don't enter the statistics.Current

Steve Lloydnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-1672276983050489972007-02-13T17:39:00.000Z2007-02-13T14:07:56.799Z

Thanks to Mona the Imperial RBs are now set up to accept camont jobs (both production RB (gfe01) and testzone RB(gm02)). Unfortunately no CEs yet seem able to take the jobs:"edg-job-list-match hostname.jdlSelected Virtual Organisation name (from JDL): camont.gridpp.ac.uk Connecting to host gfe01.hep.ph.ic.ac.uk, port 7772 ===================== edg-job-list-match failure ======================

Jeremy Colesnoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-38944393229970546792007-02-13T14:06:00.000Z2007-02-13T10:10:44.737Z

You can query the SAM results by installing lcg-sam-client from the CERN repository on a UI. Once installed and you have a proxy, it is possible to run commands like this:$ /opt/lcg/same/client/bin/same-query nodename voname servicestatus sitename=ScotGrid-Edinburgh serviceabbr=SEyou will also have to set the SAM_SERVER_HOST to lcg-sam.cern.ch. There is a config file in /opt/lcg/same/client/

Greig A Cowannoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-86572120502686007692007-02-13T09:36:00.000Z2007-02-13T09:43:54.016Z

I still haven't managed to make replicas at Durham and Sheffield. The one at Liverpool was deleted by persons unknown but is now back.There were serious problems with the IC RB on Thursday/Friday last week which caused the whole system to collapse. Now using RAL RB again.Overall success is currently 74%. All sites are working pretty well except Bristol, Edinburgh, UCL Central and QMUL. QMUL was

Steve Lloydnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-37299891987840153282007-02-12T14:03:00.000Z2007-02-12T14:01:59.961Z

My replica at Liverpool has disappeared for no apparent reason. I tried to recreate it but get obscure errors:java.rmi.RemoteException: SRM Authorization failed;...

Steve Lloydnoreply@blogger.com1tag:blogger.com,1999:blog-477896081364595668.post-20023565273478776652007-02-12T13:52:00.000Z2007-02-12T13:49:48.769Z

Since last Thursday (8/2) all my jobs were reported as "running - unavailable" and by the weekend my whole system was screwed up. I cleaned everything up and switched from the IC RB to the (2nd) RAL one. Everything seems to be OK again now. In case it has something to do with it, if I now cancel a job I mark it as cancelled in my log and don't wait to see if the status is "Cancelled" the next

Steve Lloydnoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-24059759543436678072007-02-09T10:28:00.000Z2007-02-09T09:27:34.173Z

Version 1.12 of the EU PMA certificates are available. Since LCG in their infinite wisdom sometimes don't tell you the content, here's what's new, with my annotations: * Extended life time of root certificate for SlovakGrid (SK)* Extended life time of root certificate for PolishGrid (PL)These will cause headaches for people with NSS-based browsers, like Moz and FF, but only for people with certs

Jens Jensennoreply@blogger.com0tag:blogger.com,1999:blog-477896081364595668.post-39998093936138277362007-02-08T14:32:00.000Z2007-02-08T14:31:26.934Z

We now have SE issues being discovered and reported in a number of ways. It would be useful to list the main ones and any resolutions that have been found so far.

Jeremy Colesnoreply@blogger.com0