Showing posts with label Poisson process. Show all posts
Showing posts with label Poisson process. Show all posts

Tuesday, July 18, 2017

How Changing Solar Magnetic Fields Complicate Space Weather Forecasting


Solar magnetic field lines depicted above based on a model. They are subject to further change (twisting, looping) on encountering near Earth space. This results in errors in space weather forecasts.

As noted in previous blog posts, space weather is the term which embodies all manner of phenomena that impact the Earth or its magnetosphere including magnetic substorms, sudden ionospheric disturbances (SIDs), and CMEs or coronal mass ejections. Each of these merits forecasts but the last is particularly critical in terms of priority.  Powerful CMEs of such magnitude that they merit the name "Carrington events" and originate at the solar central meridian (relative to Earth observers) are events we wish to avoid. Even a glancing blow from a CME has the potential to knock out one or more power grids such as occurred in Quebec in 1989 after a giant solar flare.

The "ultimate" CME then is that which smacks us broadside, knocking down power grids like tenpins across the side of Earth facing the Sun when it strikes. Five years ago this led to one projection from a University of Colorado astrophysicist that sheds a good deal of insight:

"It’s believed a direct CME hit would have the potential to wipe out communication networks, GPS and electrical grids to cause widespread blackout.......Just 10 minutes without electricity, Internet or communication across the globe is a scary thought, and the effects of this event could last years. It would be chaos and disaster on an epic scale."



Thus, the interest in CMEs and space weather forecasting is not some mere armchair academic obsession but has real world consequences. Even magnetic substorms which spawn SIDs can wreak their own  form of havoc including disruption of short wave and even higher radio band signals, as well as affecting navigation controls on aircraft.

My own research had focused on the origin of SIDs from a specific type of flare identifiable from its soft x-ray signature. This led me to postulate,  in early 1984,   sudden ionospheric disturbance-generating (SID) flares, with the release attendant on a change in initial free magnetic energy (E m = B2/2m ) given by:

/   t  {òv  B2/2m  dV} = 1/m  òv div[(v  X B) X B] dV 

 -   òv  {han | Jms |2 }dV       

where the first term on the right side embodies (loop) footpoint motion, and the second, joule dissipation, but with Jms the current density at marginal stability – since the marginal stability hypothesis is required for a driven process, and h an  is the anomalous resistivity. In the same paper, it was shown how the flare distribution corresponds to a Poisson process of the form P(t) =    =   exp (- l)   lt  / t!, where theoretically the Poisson mean rate of occurrence is: lm =   l Dt.

Thus tying both SIDs and CMEs together in terms of the magnitude, time and location of the flare that produced each, though in an empirical-statistical context.    As I pointed out in a paper published in The Meudon Solar -Terrestrial Predictions Workshop  e.g.

Image result for brane space, limits of scientific  inquiry,  Meudon

this was the best one could do  - minus the necessary physical details -  for a valid theoretical model. My paper ‘Limitations of Empirical-Statistical Methods of Solar Flare Prognostication’ appeared on pp. 276-284 of the Proceedings and received much attention from the other contributors - since of course it impacted in multiple ways on their work as well.  Up to the time of the paper (and even beyond) we have been constrained to rely on empirical statistical methods to compensate for the lack of more precise physical, quantitative models.

The project itself saw the input from over two  hundred solar and space physicists covering every aspect of the problem of solar-terrestrial interactions, including: long, medium and short term solar  forecasting, geomagnetic activity and auroral (substorm) forecasts, as well as ionospheric predictions.

Understandably, the more energetic and complex the solar flare the more difficulty in arriving at the prognostication needed.  The sheer diversity of flare morphology, combined with an insufficiency of detailed observations - owing to lack of proper observational tools - adversely affects the degree to which reliable forecasts can be made.  This will be expected to change with the launch of the Solar Probe Plus - renamed the Parker Solar Probe. The probe will  travel to within 4 million miles of the solar surface  (photosphere) and withstand temperatures of up to 2,500 F.  We expect the optical observations to approach the resolution of 0.1 arcsec, which many solar physicists believe is the limit needed to identify the energy release volume in coronal loops. 

Even with greatly enhanced resolution and  the acquisition of other critical data, moving beyond statistical models to wholly physical ones (yielding their own self-consistent aspects) will not be easy.
In the case of CMEs,a theoretical, quantitative strategy would revolve around obtaining the rate of increase of the poloidal magnetic flux   (Φp) associated with a specific flux rope (e.g. that shows kink or other instability) e.g.

dΦp(t )/dt

Then, for a predictive basis one would require the related function be adjusted for each potential CME (dependent on its current heliographic location) that best fits the total observed data. This function would normally be given in terms of the electromotive force associated with the active region so that:

E(t ) ≡ −(1/c)dΦp(t )/dt

Where the preceding would constitute a forecast from the theory for each CME trajectory.  This would be called a "theoretical forecast" say compared to an empirical forecast, i.e. based on analyzing the frequency and intensity of fluctuating microwave bursts over time (say several  Carrington rotations).   In the above case we see that rapid changes in the poloidal magnetic field, B p ,  can throw off theoretical model forecasts.  Hence, the more we can learn about the genesis and maintenance of such localized fields the more the models (and forecasts) can be improved.

Then there is the influence of the much larger scale solar magnetic field. Beyond all the above considerations, space weather forecasting requires understanding what happens when the Earth’s magnetic field meets the Sun’s in space. When their field lines make contact, for example, they can suddenly link up and explosively realign. Like a snapping rubber band, the field lines rebound, sparking geomagnetic storms and sending dangerous radiation toward Earth that can damage satellites and threaten power grids.

However, some conditions are more conducive to this process, called magnetic reconnection. Particularly important is the orientation of the Sun’s magnetic field. Although the Earth’s magnetic field is fixed about its North and South poles, the Sun’s magnetic field is warped throughout space, and the Earth may find itself in a part of the field pointing in a different direction at any given time. The best conditions for magnetic reconnection are when the Sun’s magnetic field is aligned southward, antiparallel to Earth’s.

Recent studies have shown that the direction of the Sun’s field can shift by the time it reaches Earth’s magnetic field, apparently twisting after passing those satellites. This could lead to inaccurate space weather forecasts. To determine why this happens, Turc et al. analyzed archival data for 82 solar storms caused by approaching magnetic clouds ejected by the Sun. The team compared solar wind measurements with data from closer satellites orbiting in and around Earth’s magnetic field and used a model to reconstruct the conditions in between. Their work zeroed in on two factors.

1) The bow shock that the Earth creates in the solar wind. Like a ship plowing through water, the Earth creates a shock wave in the solar wind as it flows past, which the Sun’s field lines must traverse. Turc et al's analysis showed that depending on their relative orientations, the shock could alter the direction of the field.

2) After crossing the bow shock, the solar field lines encounter the Earth’s magnetic field. They don’t simply meet it head-on, but instead  overlap  the Earth’s field, and are warped in the process.

The authors report that these two factors combine to shift the direction of the field, which could alter the probability of magnetic reconnection. In some cases, it even reversed a benign northward field into a reconnection-prone southward field, and vice versa. These reversals spanned roughly 20% of the Earth–Sun magnetic field boundary and lasted over half an hour, making them significant enough to potentially throw off forecasts of geomagnetic storms.

The authors report that their models successfully reproduced the observations roughly 80% of the time. But more work must be done to improve their performance and incorporate them into real-time forecasts.

In the case of SIDs and CMEs the space weather forecasting difficulties are even more formidable. But I am confident that the Parker Solar Probe will finally put us on the path to genuine space weather forecasts for all phenomena that affect the near Earth space environment.



Saturday, June 11, 2016

Establishing A Physics Identity


My Photo
Front cover of my 400+ page thesis, and me (ca. 1981) recording magnetic classifications of sunspots, estimating their areas using a solar graticule.

In a recent issue of Physics Today (May, p. 47) we learn ('Developing Physics Identities') of the various tracks to establishing a "physics identity".  The one that most caught my attention was "When you have your own ideas and your own project. Basically you're working on something not having been spurred by someone else telling you to do it."

After passing two 3-hour physics qualifying exams for the M. Sc. degree,  I was asked by my adviser whether I needed "ideas for the thesis". I told him 'no, thanks', as I had already been working on a problem of my own for the past two years. This concerned how one might use morphological and magnetic features of sunspots to predict geo-effective events, specifically flares that incepted sudden ionospheric disturbances or SIDs.  Thus, my thesis was born, leading to no fewer than six published papers in peer-reviewed journals- twice as many as any other staff members in the time.

The title of the thesis became: 'Can Sunspot Morphology Be Used To Predict The Occurrence of SID Flares?'  and had been subsequently advanced for  Ph.D. submission at my advisor's request after the publication of the first 3 papers. Exemption from the oral exam followed but the conferral of the Ph..D.  was delayed by one outside examiner (from Sweden) to "enable further observational work via the Solar Optical Telescope" (Not the Hinode one!).

Alas, after 1 1/2 years the SOT was terminated in the NASA budget under GOP pressure - and with Reagan's military expenditures already reaching $1. 7 trillion, leaving the Ph.D. stillborn. See e.g.

http://brane-space.blogspot.com/2011/06/telescope-that-never-was.html

An M.Phil. (Master of Philosophy) higher research degree, next thing to a Doctor of Philosophy or Ph.D.,  was awarded instead.  This despite the fact my thesis had produced no fewer than five papers based on original work and insights. And at 401 pages (including 68 pages of Appendices) the thesis was more substantial than most doctoral dissertations - and with more published papers engendered.

The strategic basis and motivation for my work was originally published in a paper appearing in The Journal Of the Royal Astronomical Society of Canada, e.g.



http://adsabs.harvard.edu/full/1983JRASC..77..203S

The stand-alone authorship is especially important because it discloses the person's ability to write a full scientific paper on his own, and have it published professionally. This proof alone qualified me for Full Membership  (as opposed to 'Associate') in the American Astronomical Society, despite not having the Ph.D. (My 2011 monograph, 'Selected Analyses in Solar Flare Plasma Dynamics' is the equivalent of the doctoral dissertation that never was, i.e. had the thesis been so accepted without the need for the added SOT inputs).

Not long after writing the first four chapters of my thesis, they appeared in distilled form, in two lengthy papers published in Solar Physics, e.g.


http://adsabs.harvard.edu/full/1983SoPh...88..137A

And a somewhat shorter paper that followed, e.g

http://adsabs.harvard.edu/full/1984SoPh...92..259A

Given all the material in the papers was basically from my thesis, the only elements not prepared by me (in the 2 co-authored papers) were the assorted final (publication ready) graphs and line diagrams. These were prepared by my thesis advisor (Dr. A. Achong) since he had the special technical implements to do the quality figures required. (This was for Solar Physics. ) The JRAS - for my original paper given above - didn't have these technical drawbacks and could convert ordinary black ink line drawings-figures to page compatible ones, hence I drew all those myself).

At times it was amusing leading up to the papers' submission, because I had to bring Achong up to speed on the statistical basis for the papers (e.g. Poisson distributions in the 2nd) and the physical basis for the interpretation in the first, i.e. using vector magnetograms  to support a mutual polarity intrusion leading to enhanced magnetic field gradient and higher probability of solar flare. However, Achong insisted his name go first because he was my advisor and "How would it look otherwise?"

Never mind, the ability to conceive and forge a project of my own - an extended, original work with numerous data sets and parameters - showed me I irrevocably qualified as a solar physicist. This project also sealed my identity along with my contribution to perhaps the most monumental space and solar physics project ever undertaken, The Solar -Terrestrial Predictions Workshop e.g.


Image result for brane space, limits of scientific  inquiry,  Meudon
The massive effort saw the input from over two  hundred solar and space physicists covering every aspect of the problem of solar-terrestrial interactions, including: long, medium and short term solar  forecasting, associated  geomagnetic activity and auroral (substorm) forecasts, as well as ionospheric predictions.

 My paper on the statistical limits to solar flare prognostication appeared on pp. 276-284 of the Proceedings and received much attention from the other contributors - since of course it impacted in multiple ways on their work as well.  The paper followed from the last  two chapters of my thesis and was based on the concept of a Poisson-based “delay time” for build up of magnetic free energy,  first postulated by me in early 1984,  for application to “SID” (sudden ionospheric disturbance-generating) flares, with the release attendant on a change in initial free magnetic energy (E m = B2/2m ) given by[i]:

/   t  {ò v  B2/2m  dV} = 1/m  ò v div[(v  X B) X B] dV 

 -   ò v  {han | Jms |2 }dV       

where the first term on the right side embodies footpoint motion, and the second, joule dissipation, but with Jms the current density at marginal stability – since the marginal stability hypothesis is required for a driven process, and h an  is the anomalous resistivity. In the same paper, it was shown how the flare distribution corresponds to a Poisson process of the form P(t) =    =   exp (- l)   lt  / t!, where theoretically the Poisson mean rate of occurrence is: lm =   l Dt, , with Dt  = t,  assuming the time interval Dt  = 1d. In reality, measuring constraints (say achieving uniformly equal time intervals between successive Mt. Wilson magnetograms), will usually ensure  Dt ¹ 1d, so  D ¹  t  thereby introducing a selection effect variability, complicating computation of P(t).

 It was also suggested, but not proven, that variability in l arises from  variability in vertical magnetic gradients (Bz) and critical changes in the associated current density at marginal stability (Jzms) such that:  d(Ñ(+ Bz) ) Þ d JzmsÞ dJz  ( dt)/ dt where Jz  is the vertical current density associated with putative footpoints magnetic induction (+ Bz ) and rate of change in |Bz| modulated by significant evolutionary changes (dt) in the lifetime of the magnetic field, especially critical if   dt < Dt.

Since magnetic gradients and associated scale lengths (ℓB) also will change in time, there would be scope for accepting a Poisson process of form P(t) =  =   exp (- l)   lt  / t!  which would embody an energy modulation with some inbuilt variance, with the latter having to be known to determine how much energy might be released and when. In other words, the differing scale factors inevitably introduced variabilities that were difficult to account for. The Poisson statistics therefore had to be able to take these differing modalities into account.

Below: Photo taken after being awarded the M.Phil. in Physics:


-------------------------------------

[i] Stahl, P.A. and  Achong, A.: 1984a, Proceedings of the Second Caribbean Physics Conference, Ed. L.L. Moseley, pp. 1-11.